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Row-strict Quasisymmetric Schur Functions, Characterizations of Demazure Atoms, and 
Permuted Basement Nonsymmetric Macdonald Polynomials 

Abstract 

We give a Littlewood-Richardson type rule for expanding the product of a row-strict 
quasisymmetric Schur function and a symmetric Schur function in terms of row-strict qua- 
sisymmetric Schur functions. This expansion follows from several new properties of an 
insertion algorithm defined by Mason and Remmel (2011) which inserts a positive inte- 
ger into a row-strict composition tableau. We then apply this Littlewood-Richardson type 
rule to give a basis for the quotient of quasisymmetric functions by the ideal generated by 
symmetric functions with zero constant term. 

We then discuss a family of polynomials called Demazure atoms. We review the known 
characterizations of these polynomials and then present two new characterizations. The first 
new characterization is a bijection between semi-standard augmented fillings and triangular 
arrays of nonnegative integers, which we call composition array patterns. We also provide a 
bijection between composition array patterns with first row 7 and Gelfand-Tsetlin patterns 
whose first row is the partition A whose parts are the parts of 7 in weakly decreasing order. 
The second new characterization shows that Demazure atoms are the polynomials obtained 
by summing the weights of all Lakshmibai-Seshadri paths which begin in a given direction. 

Finally, we consider a family of polynomials called permuted basement nonsymmetric 
Macdonald polynomials which are obtained by permuting the basement of the combina- 
torial formula of Haglund, Haiman, and Loehr for nonsymmetric Macdonald polynomials. 
We show that these permuted basement nonsymmetric Macdonald polynomials are the si- 
multaneous eigenfunctions of a family of commuting operators in the double affine Hecke 
algebra. 
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CHAPTER 1 



Introduction 



One of the most important bases of symmetric functions is the Schur basis s\, where A is 
a partition, which form an orthonormal Z-basis for the algebra of symmetric functions. The 
Schur functions can be defined combinatorially as the generating functions of semi-standard 
Young tableaux. There are many classical results that demonstrate the importance of Schur 
functions. For example they are characters of irreducible polynomial representations of GL n 
[15j and the image of the irreducible characters of the symmetric group under the Frobenius 
characteristic map |52j . 

Two other bases for symmetric functions are the power sum symmetric functions p\ and 
the elementary symmetric functions e\. Their relationships to Schur functions was studied 
in two classical results |52j . The Murnaghan-Nakayama rule expresses the product s\p r 
as a sum of Schur functions, and it is important to note that the coefficients appearing 
in the expansion are integers. The Pieri rule expresses the product s\e n as a sum of 
Schur functions and even more noteworthy, the coefficients appearing in this expansion are 
non-negative integers. These two results proved instrumental in determining the structure 
coefficients , called Littlewood-Richardson coefficients, for the Schur basis, which can be 
defined by the equation 



The well-known Littlewood-Richardson rule gives a combinatorial description of the 
coefficients as the number of Littlewood-Richardson skew tableaux |15j . In addition to 
their definition (jl.ip . the coefficients appear in representation theory as multiplicities 
of irreducible representations in certain induced representations of the symmetric group 
I -18 1 and also as multiplicities of irreducible representations in the tensor product of two 
irreducible GL n -modules [15] . In geometry they appear as intersection numbers in the 
Schubert calculus on a Grassmannian |15| . Note that each of these interpretations of 
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Littlewood-Richardson coefficients give proofs that the coefficients are non-negative 
integers. 

A more geometric combinatorial device used to study Schur functions are Gelfand- 
Tsetlin patterns, or GT patterns. These patterns are triangular arrays of integers with 
defining inequalities imposed upon the entries of the array |52] , A fundamental fact con- 
cerning GT patterns is that these arrays are in bijection with semi-standard Young tableaux. 
Originally defined in [16J in connection with the study of irreducible representations of Lie 
algebras, GT patterns are now studied in a variety of contexts. GT patterns of shape A and 
weight fi form a polytope, called the Gelfand-Tsetlin polytope, with the property that the 
number of integral lattice points is the dimension of the //-weight space in the irreducible 
highest weight representation V\ of gl n (C). A study of the geometric properties of the GT 
polytope has been undertaken in a number of papers, including |14j . [28], and |31j . Be- 
cause of the deep connection between representation theory and mathematical physics, it 
is not surprising that GT patterns also appear in the study of certain physical systems, for 
example see [53], [54] . and [55] , 

GT patterns and the associated polytope also appear in the more general setting of 
the Berenstein-Zelevinsky polytope [4]. The BZ polytope associated to the triple (A, /i, v) 
of partitions has the property that the number of integral lattice points is the Littlewood- 
Richardson coefficient . In the new description of the BZ polytope given in |30| . which 
the authors call the honeycomb model, the BZ polytope is presented in a way that is analo- 
gous to the GT polytope. Specifically, the authors define so called rhombus inequalities on 
a triangular array of integers; see [5] for an exposition of these inequalities. The honeycomb 
model given in [30] was the main tool in the authors' proof of the Saturation Conjecture, 
which in our present context can be stated as ^ if and only if c™^ n „ for some 
n e Z>o- 

The classical Littlewood-Richardson rule and the bijection of semi-standard Young 
tableaux with GT patterns are examples of two results on Schur functions that can be 
sought for generalizations of Schur functions. It is the purpose of this dissertation to present 
analogues of these results for various families of polynomials. 
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1.1. Quasisymmetric Functions 

Quasisymmetric functions are a natural generalization of symmetric functions and were 
defined by Gessel in [17J. Although Gessel discovered many properties of quasisymmetric 
functions, they had already appeared in earlier work of Stanley |51j . Since their introduc- 
tion, quasisymmetric functions have become of increasing importance. They have appeared 
in such areas of mathematics as representation theory |24j . symmetric function theory [BJ, 
and combinatorial Hopf algebras pQ . Quasisymmetric functions also provide ample oppor- 
tunity for combinatorial explorations of their properties, as seen in [7], [21j . and [22j . 

In [21] , the authors define a new basis of the algebra QSym of quasisymmetric functions 
called column-strict quasisymmetric Schur functions, denoted CS a , where a is a sequence 
of positive integers called a strong composition. The functions CS a can be defined as 
generating functions for composition shaped tableaux, which are certain fillings with positive 
integers of strong composition shape a subject to three relations on the entries of the 
filling. This definition parallels the combinatorial definition of Schur Functions, and in 
fact the Schur function s\ can be obtained by taking a certain sum of the functions CS a . 
Continuing the parallel, the authors in [7] give a more general definition of skew column- 
strict quasisymmetric Schur functions. 

In [22| the authors give a Littlewood-Richardson type rule for expanding the product 
CS a s\, where s\ is the symmetric Schur function, as a nonnegative integral sum of the 
functions CSn. The proof of the Littlewood-Richardson type rule in |22| utilizes an ana- 
logue of Schensted insertion on semi-standard Young tableaux, which is an algorithm in 
classical symmetric function theory which inserts a positive integer b into a Young tableau 
T. This Littlewood-Richardson type rule was used in [33j to show a certain subset of the 
functions CS a over a finite number of variables gives a basis of the coinvariant space for 
quasisymmetric polynomials, thus proving a conjecture of Bergeron and Reutenauer in [5]. 

In [44], the authors provide a row-strict analogue of column-strict composition tableaux; 
specifically they interchange the roles of weak and strict in each of the three relations 
mentioned above. See Definition 12.1.51 below. One of these relations requires the fillings 
to decrease strictly across each row, thus the name row-strict composition tableaux. This 
definition produces the generating functions 1ZS a , called row-strict quasisymmetric Schur 
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functions, which the authors show are again a basis of QSym. Also contained in [44] is an 
insertion algorithm which inserts a positive integer b into a row-strict composition tableau, 
producing a new row-strict composition tableau. This insertion procedure is presented in 
Definition [2X31 

In Section 12.21 we establish several new properties of the insertion algorithm given in 
|44j . These properties lead directly to Theorem l2.3.1l which is a Littlewood- Richardson type 
rule for expanding the product lZS a s\ as a nonnegative integral sum of the function TZSp. 
Theorem 12.3.11 was inspired by [22] and the combinatorics of this rule share many similarities 
with the classical Littlewood- Richardson rule for multiplying two Schur functions, see |15j 
for an example. We then follow the work in [33] and show in Corollary 12.4.41 that a certain 
subset of TZS a is a new basis for the coinvariant space for quasisymmetric functions. 

1.2. Demazure Atoms 

As mentioned above, the basis CS a of column-strict quasisymmetric Schur functions 
defined in |21j can be defined as generating functions for composition shaped tableaux. 
Originally, the functions CS a were first defined as certain positive integral sums of functions 
called Demazure atoms. Demazure atoms first appeared in [32] under the name "standard 
bases," and later were characterized as specializations of nonsymmetric Macdonald polyno- 
mials when q = t = 0. The latter characterization can be deduced from the results in [50] 
for affine Lie type A and |26j for general affine Lie type; latter in [42] an explicit formula- 
tion was given for finite type A. Because the functions CS a are a positive integral sum of 
Demazure atoms, the Schur function s\ decompose as a positive integral sum of Demazure 
atoms. Demazure atoms are also related to Demazure characters and Schubert polynomials 
through the use of divided difference operators [47] : see Section 13.11 The combinatorial 
construction of standard bases in 1321 involved the computation of certain Young tableaux 
called left and right keys, which we give in Definition 13.1.71 The computation of keys and 
the polynomials related to them have seen uses in combinatorics and representation theory, 
for example [2]. [34]. [35]. and [47]. 

Even with their characterizations given in [32] and [42] , little is known about the 
multiplicative structure of Demazure atoms. In an effort to advance the study of these 
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objects, we present here two characterizations of Demazure atoms not previously used in 
the literature. 

The characterization given in |42j defines Demazure atoms as the generating func- 
tions for certain semi-standard augmented fillings. Our first characterization of Demazure 
atoms, Theorem 13.3.21 is analogous to describing Schur functions as Gelfand-Tsetlin pat- 
terns. Specifically, we present a bijection between certain triangular arrays, which we call 
composition array patterns, and semi-standard augmented fillings. Then in Theorem 13.3.51 
we provide an explicit bijection between composition array patterns and GT patterns which 
completes a commutative diagram involving semi-standard augmented fillings, composition 
array patterns, Young tableaux, and GT patterns. 

Our second characterization, Proposition 13.4.31 presents Demazure atoms as certain 
Lakshmibai-Seshadri paths. Lakshmibai-Seshadri paths, or LS-paths, form the foundation 
of Littelmann's path model, which is a combinatorial tool for computing multiplicities of 
a given weight in a highest weight representation of a symmetrizable Kac-Moody algebra 
|37J j36j . Our characterization shows that Demazure atoms are the sum of the weights of 
all LS-paths beginning in a given direction. 

1.3. Nonsymmetric Macdonald Polynomials 

Another family of functions which generalizes Schur functions are the nonsymmetric 
Macdonald polynomials E^, which are defined and studied in [45], [39], and [11] among 
others. The E~ can be defined as eigenfunctions of certain operators in the double affine 
Hecke algebra defined by Cherednik |10j . [9], [13] . 

The E^ are a generalization of Schur functions in that through symmetrization of the 
E~ one recovers the symmetric Macdonald polynomials, which are a fundamental basis of 
the algebra of symmetric functions |38| . Upon different specializations of the parameters 
q and t appearing in symmetric Macdonald polynomials one can obtain Schur functions, 
Hall-Littlewood symmetric functions, Jack polynomials, monomial symmetric functions, 
and elementary symmetric functions. Many of these symmetric functions play key roles 
in representation theory, and in physics Jack polynomials are the eigenfunctions of the 
Schrodinger operator for a quantum-mechanical system [27j . 
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In |20| the authors establish a combinatorial expression of nonsymmetric Macdonald 
polynomials E^ as a sum over combinatorial diagrams, where each term in the sum depends 
on certain statistics computed from the corresponding diagram. The proof of this combina- 
torial expansion relies on a recurrence developed by Knop [29j and Sahi |49j which is actu- 
ally a special case of an intertwining formula developed by Cherednik |12j . More recently, 
the authors in |46| give combinatorial formulas for nonsymmetric Macdonald polynomials 
of arbitrary Lie type. 

One avenue to pursue in seeking classical type results for nonsymmetric Macdonald 
polynomials is to seek Littlewood-Richardson type rules for multiplication. In [3] the au- 
thor develops Pieri type formulas for the expansion of the product of a nonsymmetric 
Macdonald polynomials with certain elementary symmetric functions in terms of nonsym- 
metric Macdonald polynomials. In [56j the author gives a Littlewood-Richardson type rule 
for the expansion of the product of a nonsymmetric Macdonald Polynomials with a sym- 
metric Macdonald polynomials in terms of symmetric, and also nonsymmetric, Macdonald 
polynomials. 

Another avenue of research to pursue is to study the effects of specialization the param- 
eters q and t appearing in formulas for Ey. This as been done by several authors. In |50j the 
author establishes a connection between nonsymmetric Macdonald polynomials and the De- 
mazure characters of sl n . This result is then generalized in [26] where the author establishes 
a similar connection, but for arbitrary type. In finite type A, as we previously mentioned, 
the author of |42] shows that specializing both parameters q and t of the polynomial E~ 
produces functions now called Demazure atoms. 

Since the polynomials £L are eigenfunctions for operators Y@ in the double affine Hecke 
algebra, and can be constructed using intertwining formulas in the affine Hecke algebra, 
it is natural to ask how the functions Ey transform under the action of the Hecke algebra 
generator Tj. This question was answered in |18j . and we present it here as Proposition 
14.4.41 For reasons that will become clear in Chapter U the functions T T Ey, for arbitrary 
permutations r, are called permuted basement nonsymmetric functions. We apply Propo- 
sition to explicitly describe the operators Y[ which have the functions T T Ey as their 
simultaneous eigenfunctions. This is done in Proposition 14.4.81 We should note that one 
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can also specialize the parameters q and t in T T E^, and the resulting polynomials are the 
subject of interest in [23j . 



CHAPTER 2 

Row-Strict Quasisymmetric Schur Functions 

In this chapter we discuss certain formal power series called row-strict quasisymmetric 
Schur functions. Our first goal is to show that the product of a row-strict quasisymmetric 
Schur function and a symmetric Schur function decomposes into a positive sum of row-strict 
quasisymmetric Schur functions. This result is obtain in Theorem 12.3.11 Our second goal 
is to show that the Littlewood-Richardson type rule of Theorem 12.3.11 gives us a way to 
construct a basis for the coinvariant space for quasisymmetric functions. 

This chapter is organized as follows. Section 12.11 reviews the definitions of symmetric 
and quasisymmetric functions, and also provides the definitions needed to define row-strict 
quasisymmetric Schur functions and to describe our Littlewood-Richardson type rule. Sec- 
tion 12.21 describes the insertion algorithm originally defined in [44], and in this section 
several new properties of the algorithm are established. Section 12.31 states and proves the 
Littlewood-Richardson type rule, and in Section [2.41 we apply Theorem 12 . 3 . 1 1 to produce a 
basis for the coinvariant space for quasisymmetric functions. 



2.1. Definitions 

2.1.1. Compositions and reverse lattice words. A strong composition with k 
parts, denoted a = (a±, . . . , ccfc), is a sequence of positive integers. A weak composition 
7 = (71, . . . ,7^) is a sequence of nonnegative integers, and a partition A = (Ai, . . . , A&) is 
a weakly decreasing sequence of nonnegative integers. Let A* := (A&, A^_i, . . . , Ai) be the 
reverse of A, and let A* denote the transpose of A. Denote by 5 the unique partition ob- 
tained by placing the parts of a in weakly decreasing order. Denote by 7 + the unique strong 
composition obtained by removing the zero parts of 7. For any sequence /3 = ((3\, . . . , f3 s ) 
let i{(3) := s be the length of (3. For 7 and (3 arbitrary (possibly weak) compositions of the 
same length s we say 7 is contained in /3, denoted 7 c /3, if 7^ ^ fi i for all 1 ^ i ^ s. 
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For example a = (1,2,3,2) is a strong composition, 7 = (1,0,2,3,0,2) is a weak 
composition, and A = (3, 2, 2, 1) is a partition. Here, 7+ = a and 5 = A. Also, A* = 
(1,2,2,3) and A* = (4,3,1). 

A finite sequence w = W\W2-- -w n of positive integers with largest part m is called a 
reverse lattice word if in every prefix of w there are at least as many i's as (i — l)'s for each 
1 < i ^ m. The content of a word w is the sequence eont(io) = (cont(ui)i, . . . , cont(u;) m ) 
where cont(u;)j equals the number of times i appears in w. A reverse lattice word is called 
regular if cont(u;)i =£ 0. Note that if w is a regular reverse lattice word, then cont(u>) = A* 
for some partition A. For example w = 4433421 is a regular reverse lattice word with largest 
part 4, and cont(w) = (1,1,2,4). 

2.1.2. Symmetric and Quasisymmetric Functions. Throughout this chapter, we 
will let x := (xi, X2, X3, . . .) be a countable set of indeterminates. A symmetric function 
is a formal power series /(x) of bounded degree which is invariant under the action of the 
symmetric group on indices. In this dissertation, we will work over the field of rational 
numbers Q, but much of the theory discussed works equally as well over Z. See |52j for 
many of the properties of symmetric functions. 

Definition 2.1.1. A symmetric function f(x±, . . .) is a formal power series of bounded 
degree with rational coefficients such that for each strong composition a = (a±, . . . , a^), 
the coefficient of x" 1 ■ ■ ■ x^ k is equal to the coefficient of x? 1 • • • x"* for all ordered se- 
quences (ii, . . . ,ik) of distinct positive integers. In other words, f(x\,X2, ■ ■ ■) is symmetric 
if /(x T (!), 27(2), . . .) = f(x\,X2, ■ ■ .) for any permutation r of the positive integers. 

Example 2.1.2. The function /(x) = Yii<j 

symmetric. 

We will denote the Q-algebra of symmetric functions by Sym, however in the literature 
this algebra is usually denoted A. As mentioned in the Chapter [TJ symmetric functions are 
ubiquitous in mathematics. More recently, the larger space of quasisymmetric functions 
have begun to play a similar role. See |52j for many of the properties of quasisymmetric 
functions. 

Definition 2.1.3. A quasi-symmetric function f(x\,...) is a formal power series of 
bounded degree with rational coefficients such that for each strong composition a = (a±, 
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. . . , ak), the coefficient of x" 1 • • • x^ k is equal to the coefficient of x^ 1 • • • x" fc fe for all i\ < 
n < ■ ■ ■ < ik- 

Example 2.1.4. The function g(x) = ^i<j x 1 x j ls quasisymmetric. 

We will denote the Q-algebra of quasisymmetric functions by QSym. Notice that Sym c 
QSym since every symmetric function is also quasisymmetric. In Section 12.41 we will be 
interested in the ideal generated by symmetric functions with zero constant term inside 
QSym. 

2.1.3. Diagrams and fillings. To any sequence a of nonnegative integers we may 
associate a diagram, also denoted a, of left justified boxes with a, boxes in the ith row from 
the top. In the case a = A is a partition, the diagram of A is the usual Ferrers diagram in 
the English convention. Given a diagram a, let denote the box in the ith row and jih 
column. 

Given two sequences 7 and a of the same length s such that 7 c a, define the skew 
diagram a/7 to be the array of boxes that are in a and not in 7. The boxes in 7 are called 
the skewed boxes. For each skew diagram in this chapter an extra column, called the 0th 
column, with s boxes will be added strictly to the left of the first column. 

A filling U of a diagram a is an assignment of positive integers to the boxes of a. Given 
a filling U of a, let U(i,j) be the entry in the box A reverse row-strict Young tableau, 

or RRST, T is a filling of partition shape A such that each row strictly decreases when read 
left to right and each column weakly decreases when read top to bottom. Since we will only 
be concerned with RRST tableaux in this chapter, we will refer to these objects as tableaux 
when no confusion will result. If A is a partition with Ai = m, then let T\ be the tableau of 
shape A which has the entire ith column filled with the entry (m + 1 — i) for all 1 < i < m. 

A filling U of a skew diagram a/7 is an assignment of positive integers to the boxes 
that are in a and not in 7. We follow the convention that each box in the 0th column and 
each skewed box is assigned a virtual 00 symbol. With this convention, an entry U(i,j) may 
equal 00. Given two boxes filled with 00, if they are in the same row we define these entries 
to strictly decrease left to right, while two such boxes in the same column are defined to be 
equal. 
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The column reading order of a (possibly skew) diagram is the total order < co i on its 
boxes where < C oi j') if 3 < f or (j = j' an d * > 0- This is the total order 

obtained by reading the boxes from bottom to top in each column, starting with the left- 
most column and working rightwards. If a is a diagram with k rows and longest row length 
m, it will occasionally be convenient to define this order on all cells (i,j), where < i < k 
and 1 < j < m + 2, regardless of whether the cell is a box in a. The column reading 
word of a (possibly skew) filling U is the sequence of integers w co i(U) obtained by reading 
the entries of U in column reading order, where we ignore entries from skewed boxes and 
entries in the Oth column. 

The following definition first appeared in 



Definition 2.1.5. Let a be a strong composition with k parts and largest part size m. 
A row-strict composition tableau (RCT) U is a filling of the diagram a such that 

(1) The first column is weakly increasing when read top to bottom. 

(2) Each row strictly decreases when read left to right. 

(3) Triple Rule: Supplement U with zeros added to the end of each row so that the 
resulting filling U is of rectangular shape k x m. Then for 1 < i\ < i<i < k and 

2 < j ^ m, 

(U(i2,j) * and U(i 2 ,j) > U(h,j)) => U{i 2 ,j) > U(h,j - 1). 

If we let U(i2,j) = b, U(ii,j) = a, and U(i±,j — 1) = c, then the Triple Rule (b ¥= and 
b > a implies b ^ c) can be pictured as 



c a 



In addition to the triples that satisfy Definition 12.1.51 we also have a notion of inversion 
triples. Inversion triples were originally introduced by Haglund, Haiman, and Loehr in 
|19j and [20] to describe a combinatorial formula for symmetric, and later nonsymmetric, 
Macdonald polynomials. In the present context inversion triples are defined as follows. Let 
7 be a (possibly weak) composition and let j3 be a strong composition with 7 <= fl. Let U 
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be some arbitrary filling of /S/7. A Type ^4 irip/e is a triple of entries 

U(h,j - 1) = c, f7(n,i) = a, J7(i 2 , j) = 6 

in U with 5 s /3j 2 for some rows i\ < i 2 and some column j > 0. A Type B triple is a 
triple of entries 

U{k,j) = b, U(i 2 ,j) = c, U(i 2 ,j + 1) = a 

in U with f}^ < f3i 2 for some rows i\ < i 2 and some column j ' ^ 0. A triple of either type 
A or B is said to be an inversion triple if either b^a<c or a<c^b. Note that triples 
of either type may involve boxes from 7 or boxes in the 0th column. Type A and Type B 
triples can be visualized as 

Type A Type B 




b 




c 


a 



Central to the main theorem of this paper is the following definition. 

Definition 2.1.6. Let (3 and a be strong compositions. Let 7 be some (possibly weak) 
composition satisfying 7+ = a and 7 Q (3. A Littlewood- Richardson skew row-strict compo- 
sition tableau S, or LR skew RCT, of shape (3/a is a filling of a diagram of skew shape /3/7 
such that: 

(1) Each row strictly decreases when read left to right. 

(2) Every Type A and Type B triple is an inversion triple. 

(3) The column reading word of S, w co [(S), is a regular reverse lattice word. 

Note that in Definition 12 . 1 . 61 the shape of an LR skew RCT is /3/a although we refer to 
a filling of f5/"f. 



Example 2.1.7. Below is a RCT, U, of shape (1,3,2,2), and a LR skew RCT, 5, of 
shape (1,2,3,1,5,3)/(1,3,2,2) with w co i(S) = 4433421. 
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2.1.4. Generating functons. The content of any filling U of partition or composition 
shape, denoted cont([/), is the content of its column reading word w co i{U). To any filling 
U we may associate a monomial 

The algebra of symmetric functions Sym has the Schur functions s\ as a basis, where 
A ranges over all partitions. The Schur function s\ can be defined in a number of ways. 
In this dissertation it is advantageous to define s\ as the generating function of reverse 
row-strict tableaux of shape A*. That is 

where the sum is over all reverse row-strict tableaux T of shape A*. Sec [52J for many of 
the properties of s\. 

The generating function of row-strict composition tableaux of shape a are denoted lZS a . 
That is 

where the sum is over all row-strict composition tableaux U of shape a. The generating 
functions lZS a are called row-strict quasisymmetric Schur functions and were originally 
defined in |44j . In [44] the authors show lZS a are indeed quasisymmetric, and furthermore 
the collection of all 1ZS a , as a ranges over all strong compositions, forms a basis of the 
algebra QSym of quasisymmetric functions. The authors also show that the Schur function 
s\ decomposes into a positive sum of row-strict quasisymmetric Schur functions indexed by 



2.2. INSERTION ALGORITHMS 



14 



compositions that rearrange the transpose of A. Specifically, 

s\ = ^] TZS a . 

a=A* 

2.2. Insertion algorithms 

Define a two-line array A by letting 

I h k ■■■ i n \ 

yi 32 ■■■ Jn J 

where i r ,j r are positive integers for 1 < r < n, (a) i\ ^ ii ^ • • • ^ i n , and (b) if i r = i s 
and r < s then j r < j s . Denote by A the upper sequence i\, ii, ■ ■ ■ , i n and denote by A the 
lower sequence ji , j 2 , ■ ■ ■ , J n ■ 

The classical Robinson-Schensted-Knuth (RSK) correspondence gives a bijection be- 
tween two-line arrays A and pairs of (reverse row-strict) tableaux (P, Q) of the same shape 
|15j . The basic operation of RSK is Schensted insertion on tableaux, which is an algorithm 
that inserts a positive integer into a tableau T to produce a new tableau T". In our setting, 
Schensted insertion is stated as 



Definition 2.2.1. Given a tableau T and b a positive integer one can obtain T' := b — »• T 
by inserting b as follows: 

(1) Let b be the largest entry less than or equal to b in the first row of T. If no such b 
exists, simply place b at the end of the first row. 

(2) If b does exist, replace (bump) b with b and proceed to insert b into the second row 
using the method just described. 

The RSK correspondence is the bijection obtained by inserting A in the empty tableau 
to obtain a tableau P called the insertion tableau, while simultaneously placing A in the 
corresponding new boxes to obtain a tableau Q called the recording tableau. 
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Example 2.2.2. Below is an example of the RSK correspondence on pairs of reverse 
row-strict Young tableaux. 
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The authors in |44j provide an analogous insertion algorithm on row-strict composition 
tableaux. 

Definition 2.2.3. (RCT Insertion) Let U be a RCT with longest row of length m, and 
let b be a positive integer. One can obtain U' := U <— b by inserting 6 as follows. Scan the 
entries of U in reverse column reading order, that is top to bottom in each column starting 
with the right-most column and working leftwards, starting with column m + 1 subject to 
the conditions: 

(1) In column m + 1, if the current position is at the end of a row of length m, and b 
is strictly less than the last entry in that row, then place b in this empty position 
and stop. If no such position is found, continue scanning at the top of column m. 

(2) (a) Inductively, suppose some entry bj begins scanning at the top of column j. In 

column j, if the current position is empty and is at the end of a row of length 
j — 1, and bj is strictly less than the last entry in that row, then place bj in 
this empty position and stop, 
(b) If a position in column j is nonempty and contains bj sj bj such that bj is 
strictly less than the entry immediately to the left of bj, then bj bumps bj. 
Continue scanning column j with the entry bj, bumping whenever possible 
using the criterion just described. After scanning the last entry in column j, 
begin scanning column j — 1. 

(3) If an entry b\ is bumped into the first column, then place b\ in a new row that 
appears after the lowest entry in the first column that is weakly less than b\. 



In [44j the authors show U' = U <— b is a row-strict composition tableau. The algorithm 
of inserting b into U determines a set of boxes in U' called the insertion path ofb and denoted 
1(b), which is the set of boxes in U' which contain an entry bumped during the algorithm. 
Not that if some entry bj bumps an entry bj then bj ^ bj; thus the sequence of entries 
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bumped during the algorithm is weakly decreasing. We call the row in U' in which the new 
box is ultimately added the row augmented by insertion. If the new box has coordinates 
(i, 1), then for each r > i, row r of U' is said to be the corresponding row of row (r — 1) of 
U. 



Example 2.2.4. The figure below gives an example of the RCT insertion algorithm, 
where row 4 is the row augmented by insertion. The italicized entries indicated the insertion 
path 1(4:), which goes from top to bottom in each column and from right to left. 
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We establish several new lemmas concerning RCT insertion that are instrumental in 
proving the main theorem of this paper in Section [ 



Lemma 2.2.5. Let U be a RCT and let b be a positive integer. Then each row of 
U' = U <— b contains at most one box from 1(b). 

Proof. Suppose for a contradiction that some row i in U' contains at least two boxes 
from the insertion path of b. Consider two of these boxes, say in columns j and f such 
that (without loss of generality) j' < j. Let U'(i,j) = b\ and U'(i,j') = b%. Since b\ was 
bumped earlier in the algorithm than hi , we must have b% < b\. Since b\ and b<i are in the 
same row, and 62 appears to the left of b±, this contradicts row-strictness of U'. □ 



Lemma 2.2.6. Let U be a RCT and let b be a positive integer. Let U' = U <— b with row 
i of U' the row augmented by insertion. Then for all rows r > i of U' , the length of row r 
is not equal to the length of row i. 



Proof. Suppose for a contradiction that this is not the case. Then there exists a row 
r of V, r > i, whose length is equal to the length of row i. Call this length j. Since i is 
the row in which the new cell was added then row r in U' is the same as row r in U, except 
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in the case when the augmented row i is of length 1 in which case row (r + 1) of U' is the 
same as row r of U. Let y be the entry that scans the top of the jth column. 

We claim y ^ U(r,j). Suppose not. Then y < U(r,j). When scanning column j + 1 
if the value y was in hand at row r, we would have put y in a new box with coordinates 
(r, j + 1). Since this is not the case, y was bumped from position (s,j + 1), s > r. In this 
case y = U(s,j + 1) > = U(r,j + 1) with y < U(r,j). This is a Triple Rule violation in 
U, thus y ^ U(r,j). 

If j = 1 then since y ^ U(r,j), y would be inserted into a new row i where i > r. This 
is contrary to our assumption that the augmented row i satisfies r > i. So we can assume 

3 > 1- 

We must have U(r,j) = U'(r,j) ^ U(i,j — 1) = U'(i,j — 1), or else U would have a 
Triple Rule violation because U(i,j) = 0. Since U(i,j — 1) = U'(i,j — 1) > U'(i,j) we have 
U'(r,j) > U'(i,j). 

Consider now the portion of the insertion path in column j, say in rows i$ < i\ < 
... < it = i, where y = U'(io,j). Since y ^ U(r,j) = U'(r,j) > U'{i,j) and since the 
entries in the insertion path are weakly decreasing, there is some index £, ^ i < t, such 
that 

(2.1) U'(i t> j) >U'(r,j) > U'(i e+1 ,j). 
Since rows strictly decrease, 

(2.2) U'(it,j-l)>U'(ii,j)>U'(r,j). 
Further, note that 

(2.3) U(i p ,j) = U'(i p+1 ,j) for all ^ p < t. 
Now combining (|2.ip .( f2T2|) . and (I2.3p we get in U the inequalities 

(2.4) U(r,j) = U'(r,j) > U'(i M ,j) = U(i t ,j), 

but U(r,j) = U'(r,j) < U'(ig,j — 1) = U(ig,j — 1), which is a Triple Rule violation in U. 
Thus in all cases we obtain a contradiction. □ 
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Consider the RCT obtained after n successive insertions 

U n := (...((£>-«-&!)«- I*)... )«-&„ 

where the hi are arbitrary positive integers. Any row i of U n will either consist entirely 
of boxes added during the successive insertions, or it will consist of some number of boxes 
from U with some number of boxes added during the successive insertions. In the former 
case row i corresponds to some row i in each Uj for 1 < k < j, where k is such that the 
insertion of b^ adds a box in position (i, 1). In the latter case row i corresponds to some 
row i in each Uj for all < j < n where Uq := U. 
As a direct consequence of Lemma 12.2.61 we have 

Lemma 2.2.7. Consider U n , the RCT obtained after n successive insertions. Consider 
two rows i and i' of U n such that i < i' and row i is weakly longer than row i' . Suppose 
6/ Cl adds a box in position and b^ 2 adds a box in position (£', 1). Then k\ < k<i and the 

corresponding row i is weakly longer than the corresponding row V in each Uj for j ^ &2 • 

Proof. Suppose for a contradiction that at some intermediate step Uj row % is strictly 
shorter than V . Since row i is weakly longer than row i' in U n , we must have that for 
some £, j < £, the new box produced in the insertion of bi into Ui—\ is at the end of the 
corresponding row i and rows i and i' have the same length. This contradicts Lemma [2.2.61 

□ 

Lemma [2.2.61 allows us to invert the insertion process for RCT's. More specifically, given 
a RCT U' of shape a' we can obtain a RCT U of shape a, where a' = {a\ , . . . , aj + 1, . . . , ai) 
or a' = (ai, . . . , aj_i, 1, c^, . . . , a;), in the following way. We can un-insert the last entry, 
call it y, in row i of a', where row i is the lowest row of length j = ai + 1 or j = 1. Do so 
by scanning up columns from bottom to top and un-bumping entries y weakly greater than 
y whenever y is strictly greater than the entry to the right of y. After scanning a column, 
we move one column to the right and continue scanning bottom to top. In the end we will 
have un-inserted an entry k and have produced a RCT U such that U' = U *— k. 

2.2.1. Main Bumping Property. As above, let U be a RCT with k rows and longest 
row length m. Consider U <— b *— c with b < c. Let K- be the entry "in hand" which scans 
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the entry in the zth row and jth column of U during the insertion of b into U, where b® is 
the element that begins scanning at the top of column j, so o^ +1 := ^ the insertion of 
b stops in position (i b ,jb) then b l - : = for all positions < co l i}b,jb) m U. Similarly, 

let Cj be the entry "in hand" which we compare against the entry in the ith row and jth 
column of U <— b during the insertion of c into U <— 6, where c® is the element that begins 
scanning the top of column j. Note that c will begin scanning in column m + 2, since the 
insertion of b may end in column m + 1. But when b < c we have c^ +1 = c regardless of 
where the insertion of b ends. If the insertion of c into U *— b stops in position (i c ,jc) we 
let c* := for all positions < co i (icjc) in U <— b. 

Now consider U <— b <— a with b > a. Define &*■ as above. Similarly, we can define a*- 
to be the entry which scans the entry in the ith row and jth column of U <— b during the 
insertion of a into U <— b. Define a® to be the entry that begins scanning at the top of the 
jth column. Define a^ +2 := a. If the insertion of a stops in position (i a ,ja) then let a*- := 
for all positions < coi (i a ,j a ) in U <- b. 

Lemma 2.2.8. Let U be a RCT with k rows and longest row length m. Let a < b < c be 
positive integers. Suppose the insertion of b into U creates a new box in position (ib,jb) in 
U *— b. The scanning values bj,Cj,a*j have the following relations. 

(1) Consider U <— b <— c. 

(a) If U <— b has the same number of rows as U, then b l - A for all such 
that < i < % when j = % an d < i < k when y\ < 3 < m + 1 • 

(b) IfU*—b has one more row than U , that is % = 1, then 

b l j ^ dj for all < i < % and 1 ^ j ^ m + 1, 
Vj < c* +1 for all ib < i < k + 1 and 2 < j < m + 1. 

(2) Consider U <— b <— a. 

('oj //C/ <— /ias i/te same number of rows as U, then b l j > for all (i,j) such 

that < i < ift w/ien j = jb and < % < A; w/ien j;, < j ^ m. 
(b) IfU*—b has one more row than U , that is jb = 1, then 

b l j > a* +1 /or all ^ i ^ % and 1 < j < m, 

tfj > a*^ for all i b < z < fe + 1 and 2 < j < m + 1. 
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Remark 2.2.9. Informally, Lemma 12.2.81 states that when doing consecutive insertions 
U <— 6 <— c or U <— 6 <— a, the scanning values created by b are weakly less than the 
scanning values created by c, and the scanning values of b are strictly greater than the 
scanning values created by a. Note that > a* +1 implies &*■ > a*- for (i, j) satisfying the 
conditions of Lemma 12.2.81 part (2). 



Proof. Proof of (la): Let j — m + 1 and i — 0. Then clearly &Jn + i — b ^ c m+i ~~ c - 
Now fix the column index j > jb- Suppose by induction that b^ ^ (?■ for all p ^ i. To show 
b l j +1 < c* +1 consider the following cases. 

Case 1: Suppose bumps the entry 6* + in position (i, j) of J7, and c* does not bump 
in position of V. In this case, sC 6*. sC c*- = c* + . 

Case Suppose 6*- bumps the entry in position (i, j) of U, and c*- bumps the entry 
c) +1 = b) in position of 17'. Then < 6j = c} +1 . 

Case 3: Suppose neither nor c*- bump in position of their respective RCT. Then 
b i+1 = U- s; d- = c i+1 

Case 4-' Suppose 6* does not bump in position (i, j) of U, but c* bumps c* +1 in position 
(i, j) of U' . Consider the following diagram which depicts row i and columns j — 1 and j in 
each of £7, U <— 6, and f7 <— 6 <— c. 



f7 U ^b U +-b^c 



d 


4« 




d~ 






d 





If d is bumped by d during the insertion of 6, then d < d < < 6*- < c*- which 
contradicts row strictness of U <— 6 <— c. So assume d does not get bumped by d, that is 
d = d. We get d = d > c* ^ 6*- and since does not bump we must have b % - < c* +1 . But 
then b) = bf l < cf 1 . 

The argument above shows that for fixed j, b l j ^ c*- for all < i sS fc. But this 
immediately implies c^_ x and thus we have bj s% for all indicated in the 

lemma. 

Proof of (lb): Notice that row i + 1 in U' will correspond to row i in U for all 
«b ^ i ^ A; + 1. Since row % has only one box in it, then c* 6 = c* 6+1 for 3 ^ j ^ m + 1. So 
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assume j is fixed such that 3 < j ^ m + 1. The proof for part (la) establishes K- < A for 



< i < it, which immediately implies 6* 6 



5+1 



Now suppose by induction that \f- < for all p such that ^ < p < i for some z. We 



establish 6^ +1 < c* +z by considering the following cases. 



J+2 



Case 1: Suppose b l - bumps the entry in position of t7, and c* +i does not bump 



in position (i + 1, j) of 17'. Then < 6* < c* +1 



J+2 



Case 2: Suppose &*• bumps the entry 6* +1 in position of 17, and c* +i bumps the 



,i+i 



entry c\ + ' z = b\ in position (i + of f7'. Then < 6 



J+2 



Case 3: Suppose neither 6* does not bump in position of U and c* +1 does not 



J+2 



bump in position (i + 1, j) of U'. Then 6* + = 6* < c* + = c 

Case ^: Suppose 6* does not bump in position of U, but c* +1 bumps c* +2 in 

position (i + of J7'. Consider the following diagram which depicts columns j — 1 and j 
and the labelled rows of U , U <— 6, and U <— b ■*— c. 



U 



J+2 



u 



J+2 



17 



4 +1 



If d is bumped by d during the insertion of b, then d ^ d ^ ^j-i ^ &j ^ c } +1 which 
contradicts row strictness of U <— 6 «— c. So assume d does not get bumped by d, that is 
d = d. We get d = d > c* +1 > 6'- and since 6* does not bump we must have < c* +2 . But 



then 6* 



i+i 



h ) <c 3 



i+2 



When 7 = 2, the above argument shows b 2 ^ c l 2 for all < i ^ which implies 
the insertion of c cannot add a new box with entry c 2 in position (i&,2) of £/', otherwise 



I7'(i 6j l) < b 2 b «c c 2 b . So c 2 b 



and the above argument shows b % 2 sC c^ 1 for all 



i& ^ i ^ + 1. 

The case of j = 2 implies &5 ^ c i- The definition of insertion implies b\ = b® for all 
< i < z;,, and = for all < i < ^. Thus, the relations in part (lb) of the lemma 
follow. 
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Proof of (2a) We have b° m+1 = b > a m+2 = a by assumption. Now fix a column j > j'j, 
and assume by induction that b? > o^ +1 for all p ^ i for some i. To show > al+i we 
consider the following cases. 

Case 1: Suppose 6* bumps the entry o* +1 in position of U, and o*- +1 bumps the 
entry in position + 1) of U <- b. Then U(i,j) = > E/(i, j + 1) = a*-+\ by 
row-strictness of [/. 

Case 5: Suppose does not bump in position (i, j) of U, and a* +1 bumps the entry 
a}+\ in position (i, j + 1) of E/ *- b. Then 6} +1 = b) > a) +l > a}+\. 

Case 5: Suppose does not bump in position (i, j) of U, and a* +1 does not bump in 
position + 1) of U b. Then b) +l = b) > a} +1 = aVft. 

Case ^; Suppose 6* bumps the entry 6* +1 in position of J7, and a* +1 does not 

bump in position (i,j + 1) of U <— 6. Let U' = U <— b. Then 

U%j) = b) > b) +1 = U(i,j) > U(i,j + 1) = U'(i,j + 1). 

Because U'(i,j) = bj > a* +1 and a* +1 does not bump, we must have a* +1 < U'(i,j + 1). 
This implies 6* +1 > a l - +l = a*-+\. 

The argument above shows that for fixed j, 6* > for all < i < fc. This implies 
> a!-, which then implies the relations in part (2a) of the lemma. 

Proof of (2b): Notice that row i + 1 in U' will correspond to row i in U for all 
ib * k + 1. Since row has only one box in it, then a % j + i = a }+i f° r 2 < j < m + 1. So 
assume j is fixed such that 2 < j < m + 1. The proof for part (2a) establishes &*• > Oj +1 
for < i < ift, which immediately implies o* 6 > <^+i • 

Now suppose by induction that 6^ > a^+i for all p such that % < p < i for some i. We 
establish > Oj+i by considering the following cases. 

Case 1: Suppose 6* bumps the entry in position of U, and aV£* bumps the 
entry a*+^ in position (i + 1, j + 1) of U <- 6. Then J7(i,j) = > J7(i,j + 1) = 

U'(i + l,j + l) = a) +2 . 

Case 2: Suppose b % - does not bump in position of U, and a*-+* bumps the entry 
aj+i in position (t + 1, j + 1) of U «- 6. Then = 6j > a}+\ ^ a*+ 2 r 

Case 5: Suppose 6*- does not bump in position of f7, and a*-+* does not bump in 
position (i + 1, j + 1) of C/ «- 6. Then b) +1 = 6} > afi\ = af^ v 
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Case 4-' Suppose bj bumps the entry in position of U, and does not 

bump in position (i + 1, j + 1) of U <— fe. Let U' = U <— b. Then 



J7'(i + = 6} > 6V 



U(i,j) > U(i,j + 1) = U'(i + + 1). 



Because U'(i+l,j) = 
This implies > a : 




'i+i 



= a 



,i+2 



In the case j = 1, the definition of RCT insertion forces each scanning value b\ = b® for 
all rows ^ i ^ %. Since &5 > a§ by the argument above, and since the entries bumped by 
a® in the second column get weakly smaller we have b\ > a 2 for all ^ i ^ % as needed. □ 

We can apply Lemma 12.2.81 to prove the following proposition, which describes where 
new boxes are added after consecutive insertions. 

Proposition 2.2.10. Let U be a RCT with k rows, longest row length m. Let a, b, and 
c be positive integers with a < b ^ c. Consider successive insertions U\ := (U <— b) <— c 
and U2 := (U <— b) <— a. Let B a = (i a , j a ), Bf, = (ib,jb), and Be = {icjc) be the new boxes 
created after inserting a, b, and c, respectively, into the appropriate RCT. Let i\ be a row in 
U\ which contains a box from 1(b) and a box from 1(c). Similarly, let i<i be 

a row in U2 which contains a box (i2, J2) from 1(b) and a box (^2,^2) f rom I( a )- Then 

(1) In Ui, j c ^ j b . In U 2 , j a > 3b- 

(2) In U u In U 2 , f 2 > j 2 - 

Remark 2.2.11. Informally, part (1) of Proposition 12. 2 !T0l states that if a < b ^ c, then 
in U <— b <— c the new box created by c is weakly left of the new box created by b, and in 
U <— b <— a the new box created by a is strictly right of the new box created by b. Part (2) 
of Proposition 12.2.101 states that the insertion path of c is weakly left of the insertion path 
of b, and the insertion path of a is strictly right of the insertion path of b. 

Proof. Proof of (1): Lemma 12.2.81 part (1) shows that during the insertion of c into 
U <— b, the scanning values c^ is weakly greater than the entry occupying the box B , 
which forces the new box B c to be weakly left of B , that is j c ^ jb- Lemma 12.2.81 part 
(2) show that during the insertion of a into U <— b, the new box B a must occupy position 
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(ib,jb + 1) if the insertion process reaches this position, implying that the new box B a is 
always strictly right of the box Bf,, that is j a > jb- 

Proof of (2): Suppose for a contradiction that there is a row i\ of U\ which contains 
a box (ii , ji) from 1(b) and a box (ii,j[) from 1(c), and that j[ > j±. Then 

which contradicts row-strictness in U\. 

Again, suppose for a contradiction that there is a row %2 in JJ% which contains a box 
(*2) J2) from 1(b) and a box (i<2, j' 2 ) from 1(a) and f 2 < j 2 - If the boxes coincide, that is 
32 = j'21 then a l j 2 bumped the entry b l ? 2 in position (12,32) of Z7 <— 6, and Lemma [2.2.81 shows 
&!- 2 > «!- 2 _i_i s- a! 2 , which contradicts the definition of RCT insertion. If j' < j 2 then 

^ 2 fe,J 2 ) <a°, <b\ <U 2 (i 2 ,j 2 ) 

where a , < b°, is established by using Lemma |2. 2. 81 But this contradicts row-strictness of 

u 2 . □ 

The following lemma follows from Proposition 12.2.101 

Lemma 2.2.12. Consider the RCT obtained after n successive insertions 

U n := (...((£>-«-&!)«- fc)... )«-&„ 

with b\ < 62 ^ • • • ^ b n positive integers. Let B\, B2, ■ ■ ■ , B n be the corresponding new 
boxes. Then in U n , 

B n <col Bn-l <col ■ ■ ■ <col B\. 

Proof. Proposition 12.2.101 implies the new boxes are added weakly right to left. Let 
i\ < i 2 and consider two boxes B^ and Bi 2 in the same column. Note that Bi l and B- l2 
cannot coincide. Suppose for a contradiction that B,^ is (strictly) below Bi 2 . Suppose the 
row containing box B{ x has length j. Once B^ is added, the new boxes B^ for i\ < k < i 2 
cannot change the length of the row containing B^. Thus, when Bi 2 is added to the end of 
a row of length j — 1 strictly above the row containing B^ , we contradict Lemma [2.2.61 □ 
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2.2.2. Elementary Transformations. Knuth's contribution to the RSK algorithm 
included describing Schensted insertion in terms of two elementary transformations KL\ and 
K-2 which act on words w. Let a, b, and c be positive integers. Then 

K,\ : bca — > bac if a < b < c 
K,2 ■ acb — » caft if a < 6 < c 

The relations /Ci,/C2, and their inverses /C 1 " 1 ,/Cj 1 , act on words u; by transforming 
triples of consecutive letters. Denote by = the equivalence relation defined by using K,\ and 
/q -1 . That is, w = w' if and only if id can be transformed into w' using a finite sequence of 
transformations JC\ or /Cj~ . 

Lemma 2.2.13. Let U be a RCT and let w and w' be two words such that w = w'. Then 

U ^w = U <-w'. 

PROOF. It suffices to show 

U <^ 6 <^ c <— a = U <^ 6 <^ a <— c 

for positive integers a < b < c. 

To distinguish the two sets of boxes bumped by the entry c we will let I b (c) be the 
insertion path created when inserting c into U *— b, and we will let I ba (c) be the insertion 
path created when inserting c into U <— b <— a. Consider the insertion path I b (c). By 
Proposition I2.2.1UI we know that in U <— b <— a the insertion of a cannot end in a new box 
in the first column. Thus, for each box in I b (c) we may consider the corresponding 
box in U <— b <— a. 

We will inductively show that the insertion path of c when inserting into U <— b <— a is 
the exact same set of boxes I b (c) and bumps exactly the same set of entries in these boxes. 
Let (imaxiimax) be the largest box with respect to < co i in I b {c) mU <— b <— c, that is, the 
box (imax,imax) is the first box bumped in the insertion of c into U <— b. 

To show the base case, we need to show that the entry c bumps in box (z max , jmax) of 
f7 < — b < — a < — c, and bumps the same entry as c bumped in box (i ma x> Jmax 

) of U «- 6 c. 

We establish the base case is three steps. 
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Step 1: We claim the entry c cannot bump in a box (p, q) such that (imax> jmax) <coZ (p, <?) 
in U <— 6 <— a. Suppose for a contradiction that c does bump in box [p, q). Even if j max = 1, 
the box (p, q) must have g ^ 1 by the definition of RCT insertion; that is, if j max = 1 and 
q = 1 then p = i max - The only way c can bump in box (p, q) of J7 «— b <— a and not the 
corresponding box of C/ <— 6 is if the insertion of a changed the entry in the box (p, q — 1) 
(or added a new box with coordinates (p, q — 1)) which the scanning value c in column q 
compares to. Informally, the insertion of a into U <— b made the entry in (p, q — 1) larger, 
thus allowing c to bump in box (p, q). Thus, the box (p, q — 1) is in the insertion path of a 
in U <— b <— a, which places the insertion path of a strictly to the left of the insertion path 
of c in U <— b <— a <— c, which contradictions Proposition 12.2.101 

Step 2: We claim the box (i max , j max ) in U <— b <— a must be in the path of c. Suppose 
for a contradiction that the box (imax, Jmax) is not in the path of c. These assumptions 
imply jmax ¥= 1. The only reason why c would not bump in (imax, imax) when inserting c 
into U <— b <— a would be because a had bumped in (i m axi jmax)- Informally, the insertion 
of a into U <— b made the entry in (i m ax> jmax) too large for c to bump. Let d be the entry 
in position (i m ax; jmax — 1) of £7 <— b, U <— b <— c, and [7 <— 6 <— a. The value (i is the same 
in each of these three RCT because of our assumptions and Lemma [2.2.51 Since (i m ax ; jmax) 
is in the path of c when inserting c into U <— b, then d > c. Similarly, d > where 



Q^max 
Jmax 



is the scanning value of a. Since (i m ax 5 jmax) is not in the path ofcin{7<— 6<— a<— c 
by assumption, and since d is still the entry in position (i max , jmax — 1) when c scans it, we 



must have c = 6 



Jmax 



< a;- 



Jmax 



which contradicts Lemma 12.2.81 



Step 3: We claim the entry c bumps the same value in box (i m ax> jmax) in both U 



c and U 



a <— c. Clearly, this claim only needs to be checked when j m ax ^ 2. 



Suppose for a contradiction that c bumps a different value in (i maX) jmax) of f7 <— 6 <— a <— c. 
Then this implies the box (imax, jmax) is in the path of a and (by assumption) in the path 
of c. Consider the following diagram, which depicts boxes (i m ax, jmax — 1) and (i m ax, jmax)- 



U 



U 



u 



c U 



a U 







d 


y 







d 


c 



Jmax 
jmax 







d 


c 
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Above, d and y denote the fact that at most one of d or y could have been bumped during 
the insertion of b into U, but not both. Using Lemma 12.2.81 we get fr*. max > a* max ,i (or 

Jmax Jmax i 1 V 

Umax > a «max+i - n fog appropriate rows if the insertion of b into U created a new row). Thus 

Jmax Jmax i -L j. j. j. / 

K max > a* max >y^y. We can also establish M max s; c* max = c (or £/ max 4 max+1 c* max = 

J m ax J m ax J m ax J m ax v J m ax J m ax J max 

c). In the case y = y then either <i = 5*. max ^ 6'™ ^ c < d which is a contradiction, 

' * a Jmax — J- Jmax 

or d = d > c > fr* max . i n the case y = 6* max then d = d > c > &!; max . i n a ll cases we 

J m ax J m ax J m ax 

have d > and ^ 2/i which implies must bump in position (^max^imax 

). This 

immediately implies (by way of Proposition 12.2. 10]) that a cannot have the box (i max > jmax) 
in its insertion path. 

This completes the base case. To finish the proof we induct on the length of the path 
I b {c). Suppose by induction that the path of c in U <— b <— c is identical to the path of c 
in U <— b <— a <— c, and the bumped entries are the same in both paths, up to some box 
where the path, or the value bumped, is different. Under the inductive hypothesis the 
scanning values c r s obtained when inserting c into U <— b are equal to the scanning values, 
also denoted c r s , obtained when inserting c into U <— b *— a up to the box (i, j). We show 
in U <— b <— a <— c is in the path of c if and only if in U <— b <— c is in the path 
of c, and c*- bumps the same valued entry. We do this in three steps which are identical to 
the three steps above. 

Step 1: We claim if is in the path of c in U <— b <— a <— c, then (i, j) is in the path 
of c in U «— i» <— c. This is clearly true if j = 1. When j > 2 and if this were not the case, 
that is is not in the path of c in U <— 6 <— c, then the entry a must have (i, j — 1) in 
its insertion path in U *— b *— a, which places the path of a strictly to the left of the path 
ofcinC/<— 6<— a <— c which is a contradiction. 

Step 2: We further claim that if is in the path of c in U <— b *— c then is 
in the path of c in U <— b *— a *— c. Again, this is clearly true if j = 1. When j ^ 2 
and if this were not the case, that is is not in the path of c in U *— b <— a <— c, then 
the entry a must have bumped in position Let d be the entry in box — 1) of 

U *— b, U <— b <— c, and f7 <— 6 <— a. The fact that (i, j) is in the path of c in U <— 6 <— c 
implies d > c*-. Similarly, d > a 1 -. Under our assumptions («, j) is not in the path of c in 
£7 <— 6 *— a <— c, which implies c*- < a*- which contradicts Lemma 12.2.81 
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Step 3: We claim the same value is bumped in box oiU <— b <— c and U <— b <— 
a <— c. Observe this step only needs to be checked if j > 2. If the claim were false then 
we must have that both a and c have the box in their respective insertion paths in 
U <~ b <— a <— c. Consider the following diagram which depicts boxes (i,j — 1) and 

U U^b U^b^c U^b^a U ^b^a^c 







d 


V 



Using Lemma 12.2.81 we get bj > cl % - +1 (or > in the appropriate rows if the insertion 
of b into U created a new row). Thus bj > a*- 5= y > y. We can also establish bj c*- 
(or &*• ^ c* +1 < c* ). In the case y = y then either <i = 6j- —1 «S b % - «c c*- < <i which is a 
contradiction, or <i = d > c* ^ 6*-. In the case y = bj then <i = d > A ^ bj. In all cases we 
have d > bj and 6*- ^ y, which implies 6* must bump in position This immediately 

implies (by way of Proposition 12.2. 10]) that a cannot have the box in its bumping path. 

Thus the path of c in U <— b <— c, I b (c), is exactly the same set of boxes as the path of 
c in U ^— 6<— a<— c, I ba (c). In both cases the same valued entries are bumped. 

Now consider the insertion path I b {a) of a in U <— 6 <— a. By Proposition 12.2.101 the 
insertion of c into C7 *— b may create a new box in the first column. Despite this we may still 
consider the boxes in U *— b *— c that correspond to the boxes in I b (a) since any particular 
box in I b (a) corresponds to the box in U <— b <— c if row i is above the new row 
created by c, or in I b (a) corresponds to + in U *— b *— c if row i is weakly below 
the new row created by c. With this in mind we will denote by the box in U *— b <— c 
that corresponds to the box in I b (a). 

Note that in both U <— 6 <— a and f7 <— 6 <— c <— a the path of a cannot contain a box 
in the first column of the respective RCT. 

We will inductively show that the path of a in both U <— b <— a and U <— b <— c <— a 
consists of the the same (corresponding) boxes and the entries bumped in each path are 
equal entry by entry. Let (i max , jmax) be the largest box in I b (a) with respect to < co i- The 
base case can be established in three steps. 
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Step 1: The entry a cannot bump before the box (i m ax 5 jmax)- Suppose for a contradic- 
tion that a bumped in some box (p,q) with (i m ax,jmax) <coi (p,q)- This implies that the 
box (p, q — 1) is in the path of c in U <— b <— c <— a. 

Assume q — 1 ^ 2. Consider the diagram below, which depicts boxes (p, q — 2), (p, q — 1), 
and (p, q). 



U 



U 



U 



U 



U 



d 









z 


d 


y 



d 



where either z or d could equal a (but not both). We then get the inequalities a > y which 
forces a ^ d. By Lemma [2.2.8l we know > a, which implies b^_ 1 > d^ d. Thus the box 
(p, q — 1) is not in the path of b and d = d. On the other hand we see z > c^_ 1 ^ }? ±, and 
since the path of c cannot be strictly right of the path of b we also see the box (p, q — 2) is 
not in the path of b and thus z = z. In the end we get the relations z > 6^_ 1 and 6^_ 1 > d 
which implies the box (p, q — 1) is in the path of b and is a contradiction to the previously 
established condition on the box (p, q—1). 

Now we can assume q — l = l. In this case the box (p, q — 1) = (p, 1) is still in the path of 
c and the position (p, q) = (p, 2) is empty during the insertion of a. With our assumptions 
that (p, 2) is in the path of a in U <— 6 <— c <— a and (i max , Jmax) <coi {p->q) this forces 
imax = 2 and the insertion of b must have created a new box in the first column, say in 
position (r, 1) with r < p. This means position (r, 2) is empty during the insertion of a and 
by Lemma I2.2.8( K > a and thus a must insert in position (r, 2) . Which means a cannot 
have (p, q) in its path. 

Step 2: We claim the entry a must bump in box (« m ax,imax)- Suppose for a contradiction 
that a does not bump in box (i 

max) Jmax) during the insertion of a into £/ < — b < — c. If a does 
not bump in box (i max , Jmax) then we must have (i m ax, Jmax) in the path of c. As indicated 
above, j max ¥= 1- 
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Consider the following diagram which depicts boxes (i ma , x , jmax — 1) and (« m ax>jmax) 
and the corresponding boxes (i 

max) jmax 1) and (imax; Jmax)- 

U U^b U^b^a U^b^c U ^b^c^a 



d 


y 




d 


y 




d 


a 




d 


^max 




d 
















Jmax 






Jmax 



where neither box (i m ax, jmax) nor (i 

max; Jmax 1) can be in the path of b since the box 
(Wiimax) is in the path of a and (i m ax 5 jmax) is in the path of c. From our assumptions 
we get the inequalities d > a ^ y and d > c*™ ax _ > a. Now consider the scanning values 
obtained during the insertion of b. Lemma 12.2.81 implies 6* max > a* max ,-, = a ^ y and 
d > c* max > K max . These inequalities force the box (z max , jmax) to be in the path of 6, which 

j max J max 

contradicts properties previously established. This implies a must have (i max ,jmax) in its 
insertion path in U *— b <— c <— a. 

S^ep 5: The entry a bumps the same entry in box (i max > jmax) in U <— 6 <— a as a bumps 
in box (i m ax) jmax) in C/ <— b <— c <— a. Suppose for a contradiction that a bumps a different 
entry in box (i 

max? jmax) during the insertion of o into U * b * c. This implies (imax> jmax) 
is in the path of c (and by assumption in the path of a). But this contradicts Proposition 
12.2.101 as the path of a must be strictly rightly right of the path of c. 

Now induct on the boxes in I b (a). Suppose by induction that the path of a in U <— b <— a 
is identical to the path of a in U <— b <— c <— a, and the bumped entries are the same in 
both paths, up to some box where the path, or the value bumped, is different. Under 
the inductive hypothesis the scanning values a r s obtained when inserting a into U <— b are 
equal to the scanning values, also denoted a r s , obtained when inserting a into U <— b <— c 
up to the box We show in U <— b <— a *— c is in the path of a if and only if (i, j) 

in U <— b *— c is in the path of a, and cij bumps the same valued entry. We do this in three 
steps which are identical to the three steps above. 

Step 1: If (i, j) is in the path ofaint/ <— 6 <— c <— a then (i, j) must be in the path of 
a in U *— b *— a. If this were not the case then the box (i, j — 1) is in the path of c. 
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Assume j — 1 ^ 2. Consider the diagram below, which depicts boxes (i,j — 2), — 1) 
and (i, j) and the corresponding boxes — 2), — 1), 



U 



U 



u 



u 









z 


d 


y 









z 


d 


y 





r 1 




z 


C J-1 


y 



u 



where either z or d could equal a*- (but not both). We then get the inequalities a % - ^ y which 
forces a l j ^ d. By Lemma 12.2.81 we know b'j_ 1 > which implies b l j_ 1 > d ^ d. Thus the 
box — 1) is not in the path of b and d = d. On the other hand we see z > c* _ 1 ^ i) 
and since the path of c cannot be strictly right of the path of b we also see the box (i, j — 2) 
is not in the path of b and thus z = z. In the end we get the relations z > 6* _ 1 and 6* _ 1 > d 
which implies the box — 1) is in the path of b and is a contradiction to the previously 
established condition on the box — 1). 

Now we can assume j — 1 = 1. In this case the box (i,j — 1) = (i, 1) is still in the path 
of c and the position = (i, 2) is empty during the insertion of a. With our assumption 
that = (i, 2) is in the path ofain?7<— 6<— c<— a this implies the insertion of b must 
have created a new box in the first column, say in position (r, 1) with r < i. This means 
position (r, 2) is empty during the insertion of a and by Lemma I2.2.8| V- > a l j and thus a*- 
must insert in position (r, 2). Which means a cannot have = (i, 2) in its path which is 
clearly a contradiction. 

Step 2: If is in the path of a in U <— b <— a, then the box is in the path of a 
in U <— 6 <— c <— a. As stated above, j ^ 1. Suppose for a contradiction that is not 
in the path of a. Then the box is in the path of c. As above consider the following 
diagram which depicts boxes — 1) and (i, j) and the corresponding boxes — 1) and 

Si)- 

U U^b U^b^a U^b^c U^b^c^a 



d 



y 



d 



y 



d 



d 



d 



where neither box (i, j) nor (i, j — 1) can be in the path of b since the box (i, j) is in the path 
of a and is in the path of c. From our assumptions we get the inequalities d > o*- > y 
and d > dj > a*-. Now consider the scanning values obtained during the insertion of b. 



Lemma 12.2.81 implies bj > o,j + i ^ a) ^ y and d > c*- > These inequalities force the 
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box to be in the path of b, which contradicts properties previously established. This 
implies a must have in its insertion path in U <— b <— c <— a. 

Step 3: The values bumped by a % - is the same in both U <— b <— a and U <— b <— c «— a. 
If this were not the case, then both a and c would have the box in their respective 
paths, which violates Proposition 12.2.101 

□ 

Remark 2.2.14. In addition to showing U *— b <— c ^ a = [/ <— 6 <— a *— c, the 
proof above shows that the new boxes added by a, b, and c occupy the same corresponding 
positions in each of U <— 6 <— c <— a and U <— b <— a <— c. 

2.3. A Littlewood-Richardson Type Rule 

In this section we state and prove the main result of this chapter, which is 

Theorem 2.3.1. Let s\ be the Schur function indexed by the partition X, and let lZS a 
be the row- strict quasisymmetric Schur function indexed by the strong composition a. We 
have 

(2.5) ns a -s x = Y,ci iX ns p 

where C^ A is the number of Littlewood-Richardson skew RCT of shape (3/a and content A*. 

Proof. It suffices to give a bijection p between pairs [17, T] and [V, S] where U is a 
RCT of shape a, T a tableau of shape A*, V is a RCT of shape /3, and S is a LR skew RCT 
of shape (3/a and content A*. Throughout this proof, Ai = m. 

Given a pair [U, T], produce a pair p([U, T]) = [V, S] in the following way. First use the 
classical RSK algorithm to produce a two-line array A corresponding to the pair (T,T^t). 
Next, successively insert A into U while simultaneously placing the entries of A into the 
corresponding new boxes of a skew shape with original shape a/ a. This clearly produces a 
RCT V of some shape (3 and a skew filling S of shape f3/j where 7 + = a and the content 
of S is A*. 

To show that the skew filling 5 is indeed a LR skew RCT, first note that since A is 
weakly decreasing, no row of S will have any instance of entries that strictly increase when 
read left to right. Since A is a two-line array, if i r = i s for r < s then j r ^ j s . Lemma [2.2.81 
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then implies that each row of S has distinct entries. Thus, the rows of S strictly decrease 
when read left to right. 

Consider the portion of A where A takes the value i. The corresponding entries in A, 
when read from left to right, are the entries appearing in the (m — i + l)st column of T 
read from bottom to top. Now consider a different portion of the two-line array A where 
A takes values i and i — 1. For the moment, let this portion of A be denoted A(i,i — 1) 
and suppose the number of i's is and the number of {i — l)'s is where r,; > n-i 

since A is a regular reverse lattice word. We will let the Knuth transformation /Ci act on 
A(i, i — by letting /Ci act on A(i, i — 1) and by considering each vertical pair as a bi-letter. 
We will apply a sequence r of transformations /Ci to A(i, i — until tL4(z, i — 1)] consists 
of ri — n—i number of i's followed by rj_i pairs of the form — 1). Such a sequence r 
exists because the entry in row rj_i — + 1 (for 1 < k < r.j_i) and column m — i + 2 of T is 
strictly less than each entry in column m — i + 1 which appears weakly higher in T. If we 
replace A(i,i — 1) with r[A(i,i — 1)] in A to obtain some array B, then Lemma 12.2.131 and 
Remark 12.2.141 imply 

U^B = U^A = V, 

and the corresponding new box created by any entry j in B is in the same position as the 
new box created by the same entry j in A. The advantage of replacing A with B is that now 
Proposition 12 . 2 . flJI can be applied to each of the rj_i pairs (i, i — and their corresponding 
entries in B to imply that in any prefix of the column word of S, the number of z's will be 
at least the number of (i — l)'s. Hence w co i(S) is a regular reverse lattice word. 

Next we check that each Type A and Type B triple in S is an inversion triple. Below 
are the eight possible configurations of Type A triples in the skew filling S. 
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c 


a 


00 
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c 


00 


00 


00 


c 


00 


00 
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00 


00 




b 




00 




b 




b 




b 




00 




00 




00 



For each arrangement in the figure above, the higher row is weakly longer than the 
lower row because we only consider Type A triples for now. Note that the fourth and 
sixth arrangements cannot exist in S by Definition I2.2.3[ and the seventh arrangement 
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cannot exist in S by Lemma 12.2.71 We can check the remaining arrangements to prove 
each are inversion triples. For the first arrangement c must clearly be added before a and 
Lemma 12.2.71 implies a is added before b, which forces the relation c > a 5= b. The second 
arrangement is always an inversion triple. In the third arrangement Lemma 12.2.71 implies 
a must have been added before b, hence this arrangement is an inversion triple. The fifth 
and eighth arrangements are always inversion triples. 

Below are the eight possible arrangements of Type B triples in the skew filling S. 



b 
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00 
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00 




b 




00 




00 
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00 
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00 
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GO 
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00 


00 


c 


00 


00 


00 



In each of the arrangements above the higher row is strictly shorter than the lower row. 
Note that the second and seventh arrangement cannot exist in S by Definition 12.2.31 For 
the first arrangement Lemma 12.2.61 implies the boxes must have been added in the order b, 
c, a or c, a, b, giving the relations b ^ c> a or c> a ^ b. The third arrangement is always 
an inversion triple. For the fourth arrangement, Lemma 12.2.61 implies a must have been 
added before b, hence this arrangement is an inversion triple. The fifth, sixth, and eighth 
arrangements are always inversion triples. 

Thus, we have shown the skew filling S is indeed a LR skew RCT of shape /3/a and 
content A*. 

Given a pair [V,/S], produce a pair /? -1 ([V, S]) = [U,T] in the following way. We can 
un-insert entries from V by using S as a sort of road map. Specifically, un-insert the entry in 
V whose box is in the same position as the first occurrence (in the column reading order) of 
the value 1 in S. This produces a pair (1, j) which, when arranged as a vertical bi-letter, is 
the last entry of a two- line array. Next, proceed inductively by, at the ith. step, un-inserting 
each entry of V which corresponds to each occurrence of the value i in S. The row-stirctness 
of S, combined with the triple conditions imposed on S, ensure that after each un-insertion 
from V the resulting figure is an RCT. 

What remains after un-inserting the entries is an RCT U of shape a since S had shape 
(3/a. The two line array produced is a valid two-line array A by virtue of w co i(S) being a 
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regular reverse lattice word. By RSK, A corresponds to a pair (T,T\t). Thus we have a 
pair [U, T] where U is an RCT of shape a and T is a tableau of shape A*. 

□ 

Figure 12.11 gives an example of the bijection p given in the proof of Theorem 12.3.11 
/ 1 i I I A I 3 I 9 I i I \ 
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Figure 2.1. Example for a term of TZS 



(1,3,2,2) ' s (3,2,l,l) 



2.4. A Basis for the Coinvariant Space for Quasisymmetric Functions 

In this section we follow [33j , with one main exception. In [33j the authors are concerned 
with symmetric and quasisymmetric polynomials where the number of variables n is finite 
and is at least the length of the compositions and partitions indexing the quasisymmetric 
and symmetric polynomials, respectively. We will continue to work with formal power series 
because the basis of row-strict quasisymmetric functions is not linearly independent when 
the number of variables n is less than the degree of the function. For example, if we restrict 
to three variables one can easily compute 1ZS ( 3 2 )( x ii x 2, X3) = (1,3,1) (xi> X2, £3). If a is 
any sequence of nonnegative integers, in particular a composition or a partition, then the 
problem of linear dependencies arising after restriction to a finite number of variables can 
be remedied by requiring n ^ \a\, where \a\ := Yjk=i a k is the size of alpha. If \a\ = d, we 
call a a composition (or partition) of d. 
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In this section we will consider QSym as a module over Sym. Throughout, let QSym d 
be quasisymmetric functions of homogeneous degree d. Then QSym = ©dj>o QSym d . Let 
(£) be the ideal in QSym generated by the elementary symmetric functions of degree d > 0. 

The following definitions first appear in [5]. Let a be a strong composition with largest 
part m. We call a inverting if and only if for each 1 < i ^ m, there exists a pair of indices 
s and t with s < t such that a s = i and at = i — 1. For example a = (1,3,1,2,3,1,2) 
is inverting but /3 = (1, 2, 1, 2, 3, 1, 3) is not inverting. Any composition a can be factored 
uniquely as 

a = (a', k ik ,...,2 i2 ,l h ) , ij > 1 

where the prefix a' has no parts of size 1,2, ... ,k. We call a composition a pure if and only 
if k is even. Note that if the last part of a is not 1, then k = and hence is pure. As an 
example, a = (5, 4, 3, 5, 2, 1, 1) is pure with k = 2 but j3 = (5, 4, 3, 5, 1) is not pure because 
k = 1. 

Define i? to be the set of pure and inverting compositions and 

£ d := {s x HS a | |A| + \a\ = d, a e B). 

Then we have 

Proposition 2.4.1. The collection £ := Ud>o ^ is a basis f or QSym. 

Before we prove this result, we need to establish some preliminaries. As in [33], define 

PB d := {(A, a) | A a partition, a e B, |A| + |a| = d} 
Cd '■= {/3 | /? a composition, |/3| = d}. 

Define a map 4>: PB d — » Cd as follows. Let (A, a) e PBd- Then <ft((A,a)) is the 
composition obtained by adding A* (the ith part of A') to the ith largest part of a for all 
1 < i < ^(A). If ctj = 0^ for some j < k, then we consider larger than ay. In the case 
where £(a) < ^(A*), append ^(A*) — £(a) zeros to a to make the two sequences the same 
length. See Figure l2~4l for an example. 

The following proposition was given in [33] in the case where the lengths of each se- 
quence in question were at most n, their motivation being to work with symmetric and 
quasisymmetric polynomials in variables x±,X2, ■ ■ ■ ,x n . Since the authors' proof is given for 
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<M(A,«)) 



a 



A 



(3,3,2,2,2,1,1) 
(1,3,1,2,3,1,2) 

(1,3 + 5,1,2,3 + 7,1,2 + 2) = (1,8,1,2,10,1,4) 



Figure 2.2. <j>: PB 27 -> C 27 



arbitrary n and d, the proposition holds in our situation for the infinite set of indeterminates 
x = (xi,x 2 , . . •). 

PROPOSITION 2.4.2. f]33] ) The map <p is a bijection between PB d and Cj. 

As in |33| we will need the so called lexrev order on compositions. First recall the 
lexicographic order ^\ cx on partitions of n, which states that A ^\ cx \i if and only if for 
some k, Aj = /ij for all 1 ^ i < k and A& > Note that ^i GX is defined on compositions 
as well. For compositions a and (3 of n we say a is greater than /3 in the lexrev order, and 
write a > (3 if and only if 



To prove Proposition I2.4.H we will compute the leading term of s\1ZS a relative to the 
lexrev order. To do this, we will need a distinguished Littlewood-Richardson skew RCT of 
shape 4>((X, a))/a which we call, as in [33], the super filling and denote it by SU(X, a). We 
construct SU(X, a) as follows. 

Let a be a strong composition and A a partition. If ^(A*) > i{a) append zeros to the 
end of a so that the resulting composition has the same length as A*. If A* and a satisfy 
^(A*) ^ £(a) then no action is needed. As in the definition of LR skew RCT, the cells of a 
will be filled with virtual oo symbols with the convention that given two boxes filled with 
oo, if they are in the same row we define these entries to strictly decrease left to right, while 
two such boxes in the same column are defined to be equal. Recall that for an arbitrary 
partition /x with largest part m, is the (reverse row-strict) tableau that has the entire 
ith column filled with the entry (m + 1 — i) for all 1 ^ i ^ m. Now append the ith row of 



(1) 5 S*icx /5, or 

(2) a = j3 and a* is lexicographically greater than /3*. 



For example, if we take the eight compositions of 4, we see 



(4) > (1,3) > (3,1) > (2,2) > (1,1,2) > (1,2,1) > (2,1,1) > (1,1,1,1). 
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T\t to the ith. longest row of a. If two rows of a are the same length, then the lower row is 
considered longer. 

For example, if a = (1, 3, 1, 2, 3, 1, 2) and A = (3, 3, 2, 2, 2, 1, 1) then SU(X, a) is 
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Lemma 2.4.3. The super filling SU(X,a) is a LR skew RCT of shape 4>{{\,a))/a and 
content A*. 

Proof. By construction SU(\,a) has shape </>((A, a))/a and content A*. Clearly, the 
entries in the rows of SU(X, a) which are not oo strictly decrease. Thus we only have to 
show that every Type A and Type B triple is an inversion triple, and that the column 
reading word is a regular reverse lattice word. Throughout this proof, let (3 be the shape 
of SU(X,a). 

Consider a Type A triple in rows %\ and ^2, where i\ < i% and f3{ 1 ^ /3j 2 . Below are the 
only possible configurations of Type A triples in SU (A, a): 
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Note that the fourth and sixth arrangements are not possible in our construction. We 
see that in the seventh arrangement we must have < a{ 2 , which means we append cells 
first to the row i<i and then append weakly fewer cells to row i\. Thus it is impossible to 
have ^ /3j 2 , so the seventh arrangement is impossible. 

Next we check the remaining arrangements are all inversion triples. In each arrangement, 
a = c — 1, so that in the first arrangement we must have either b^c>a or c>a^b. 
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The second arrangement is clearly an inversion triple. In the third arrangement if = ati 2 
then a = b and we have an inversion triple. If on the other hand on x > ai 2 , then a > b and 
we have an inversion triple. (As was previously mentioned, it is impossible for on t < on 2 .) 
The fifth and eight arrangements are clearly inversion triples. 

Consider a Type B triple in rows i\ and 12, where i\ < %% and /3j x < /3j 2 . Below are the 
eight possible arrangements of Type B triples in SU(X,a): 
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Note the second and seventh arrangements are impossible in our construction. In each 
arrangement we again have a = c — 1, so in the first arrangement we must have either 
b ^ c > a or c> a ^ b. The third arrangement is clearly an inversion triple. In the fourth 
arrangement cells were appended to row 12 before row i±, so b < a and we have an inversion 
triple. The fifth, sixth, and eighth arrangements are clearly inversion triples. 

The last property to check is that the column reading word w co i(SU(X,a)) is a regular 
reverse lattice word. Clearly, the first entry in w co i(SU(X, a)) is m, which is the largest part 
of A*. By construction the entries in the rows of SU(X, a) are m, m — 1, m — 2, . . ., so prior 
to reading any entry j < m in row i, one must have read the entry j + 1 that is immediately 
to the left of j in row i. Thus the column reading word is a reverse lattice word. Also, the 
column reading word contains at least one 1 by construction. Therefore the column reading 
word is a regular reverse lattice word. □ 

PROOF of Proposition 12.4.11 Order the compositions of d by the lexrev order. This 
puts an order on the basis elements TZSp of QSym d . Order the elements of £d by mapping 
the pair (A, a) under ^ to a composition of d. We claim that the leading term in the 
row-strict quasisymmetric Schur expansion of s\lZS a is the function TZS^x 

First notice that TZS^x )CK )) is a term in the expansion of s\1ZS a , since by Lemma \2. 4. 31 
the super filling SU(X,a) is a LR skew RCT of shape 4>((X,a))/a and content A*. Thus it 
suffices to show that the composition /3 = <j)((X,a)) is the largest composition appearing in 
the expansion of s\lZS a with respect to the lexrev order. 
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Given A and a, to construct the largest possible composition that might appear in the 
expansion of s\1ZS a we first have to append as many cells as possible to the longest row 
of a, taking into account that if two rows of a have equal length then the lower row is 
considered longer. The last entry in this row must be 1 since the column reading word is 
a regular reverse lattice word. The entries of this row must also strictly decrease from left 
to right and the maximum entry in the row must be at most L = £(X), because the content 
of the filling is A*. Therefore, to append as many cells as possible to the longest row of a, 
one must append A^ cells filled with L,L — 1,... ,2,1. 

Similarly, to append the maximum possible number of cells to the ith longest part of a 
(again, insuring we have the largest possible composition in lexrev order), one must append 
A* cells filled with entries L,L — l,...,j where j is the minimum positive entry in A* — (i^^). 
If ^(A*) > 1(a), then append the extra parts of A* from least to greatest and from top to 
bottom, after the last row of a. The resulting shape, which is largest in the lexrev order by 
construction, is precisely 0((A,q)). 

Since (j) is a bijection and we have a triangular decomposition of the elements in in 
terms of the basis TZSp, we therefore have is a basis for QSym d . Notice that in construct- 
ing the largest possible composition /3, the entries filling the shape 0((A,a)) were uniquely 
determined. Thus the super filling SU(X, a) is the only LR skew RCT of that shape. 
Therefore, the transition matrix between and the basis IZSp is uni-uppertriangular. 

If we now union over the degree d, we have the required basis for QSym. □ 

From [33] and |43| we can established that the only row-strict quasisymmetric Schur 
functions 7^.5,3 that appear in Sym are those where /3 is of rectangular shape. The only 
rectangles which are inverting are those of the form (l fc ), but these rectangles are not pure. 
Thus as a consequence of Proposition 12.4.11 we have the following. 

Corollary 2.4.4. The set {lZS a \ a pure and inverting] is a basis for QSym/ (£) . 



CHAPTER 3 

Characterizations of Demazure Atoms 

In this Chapter we present six equivalent characterizations of Demazure atoms, four of 
which are known in the literature and two of which are new. The chapter is organized as 
follows. In Section 13.11 we record two characterizations of Demazure atoms first given in 
[32], one of which is Definition 13.1.11 which we use later in the chapter. In Section [3.21 we 
present the characterization of Demazure atoms given in |42j . and we also record a bijection 
from [21J between semi-standard augmented fillings and certain column-strict composition 
tableaux; this bijection yields yet another characterization. We use this bijection in Section 
13.31 to give our first new characterization of Demazure atoms. Specifically, we present 
Definition l3.3.1l which is a new Gelfand-Tsetlin type triangular array of nonnegative integers 
which we call composition array patterns. We show in Theorem l3.3.2l that there is a bijection 
between certain column-strict composition tableaux and composition array patterns. In 
Theorem 13.3.51 we give a bijection O between composition array patterns of shape 7 and 
Gelfand-Tsetlin patterns of shape 7 := A. Finally, in Section [374l we use Lakshmibai-Seshadri 
paths to give our second characterization of Demazure atoms. 

Throughout this chapter, all Young tableaux will follow the English convention. Recall 
that a word w = w\W2 ■ ■ ■ w n is any finite sequence of positive integers. We will frequently 
use the Bruhat order on permutations of the symmetric group S n on n letters [25j . Let on 
be the simple root which has a 1 in position % and a —1 in position % + 1 for 1 < i < n — 1. 

3.1. Keys and Divided Difference Operators 

Demazure atoms first appeared in [32j under the name "standard bases." In this section 
we present two characterizations of Demazure atoms from |32j. 

3.1.1. Divided Difference Operators. Fix n e Zj>o- Let P = Z[x\,X2, ■ ■ ■ ,x n ] and 
let S n be the symmetric group on [n]. For 1 < i < n define linear operators on P by the 
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formulas 



(3.1) 



1 - Sj 



and 7Tj = diXi. 



These operators obey the following relations. 








djdi for \i — j\ > 1 



(3.2) 



Sid i+1 di 



TTjTTi for |i — j| > 1 



7ri + i7Ti7ri + i 



The relations 7Tj7Tj = TTjiTi for |i — j| > 1 and 7Tj7Tj + i7rj = 7Tj + i7Tj7rj + i together are called frraid 
Let t e S n and let r = ■ ■ ■ Si k be a reduced word of r. Define 



Due to 13.21 and the fact that any two reduced words are connected by a sequence of Coxeter 
relations, (j3.3[) is well defined. The operator ir T is called a Demazure operator. 

Given any partition A of length at most n, we can append zeros to the end of A so that 
the resulting sequence has length equal to n. We may then define x A := x^ 1 ■ ■ ■ x^ n ; we 
briefly note that x' 3 , for any composition f3, is defined similarly. The polynomial defined by 
7r T (x A ) is the (type A) Demazure character corresponding to the dominant weight A and 
permutation r. 

For a fixed partition A, the set of monomials in the Demazure characters 7r T (x^) and 
7r w (x A ) may in general intersect nontrivially. This fact is clear from the definition of 7r r , 
since if ui < r in Bruhat order then the set of monomials in 7r^(x^) are a subset of the 



(3.3) 



7Tt = 7!^ • • • 7Tj fe • 
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monomials in 7r r (x A ). For example when n = 3 and A = (2, 1), 

7ri7r 2 (XiX2) = x\x2 + x\x% + X\x\ + X1X2X3 + x\x% 

( 2 \ 2 ,2 
Tr 2 {X 1 X2) = X ± X 2 + X ± X3. 

We see that the monomial x\x%, which has weight (2, 0, 1), appears in both 7ri7T2(xfx2) and 
TT2{x\x2) even though the weight space with weight (2,0, 1) is one dimensional. 

This motivates replacing the operator 7Tj with 7fj := m — 1. The operators 7fj satisfy 
7f| = — 7Tj and the braid relations, so fry is still well defined. This leads to the following 
definition. 

Definition 3.1.1. The polynomials 7f T (x A ), for A a partition and r a permutation, are 
called Demazure atoms. 

Remark 3.1.2. Let Stab(A) be the stabilizer of A under the action of S n on the parts 
of A, where £(X) sC n. If Sj e Stab(A) then 7fj(x A ) = 0. There is a unique element r of 
minimal length in S n / Stab(A) taking A to the weak composition 7 = t(A). Henceforth, 
we will implicitly assume we are always taking r e S' n /Stab(A) a minimal length coset 
representative and we will denote ^l T (^)(xi, . . . ,x n ) := 7f T (x A ). 

Given a monomial x' 3 we can describe the action of 7fj as follows. 

TT^) = X^ + x' 3 " 2 " 1 + • • • + X^^ if fc = ft - + 1 > 0, 

(3.4) 7f i (x /3 ) = ifft = /3 i+ i, 

Tti(xP) = -(^ + x /3+Ql • • • + -xP+ik-Vai) ii k = ft+i - f3i > 0. 

Because the Demazure atom is defined as 7f T (x A ) where A is a partition, using the description 
of the action of 7fj in (13.4p we can see that Demazure atoms have positive integral coefficients. 
This is also apparent by using the equivalent definition of Demazure atoms in Lemma 13.1.91 
below. 

The following lemma will be used in Section [3.4i Let [x^]/ be the coefficient of x' 3 in 
the polynomial /. If [x' 3 ]/ ^ then we will say the monomial x' 3 is in the polynomial /. 
In the case of Demazure atoms, if x^ is in tt t (x A ) then [x /3 ]7f T (x A ) = c> 0. 
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Lemma 3.1.3. Let r be a fixed permutation and let 7 be a fixed weak composition. Let i 
be such that l(sir) > £(r). We have [x 7 ]7f SiT (x A ) = c > if and only if each of the following 
conditions are met. 

(1) [x 7 ]7fj(x^) = 1 for some x' 3 in 7f T (x A ). Hence 7 = j3 — ton f or some < t < 
{Pi ~ Pi+l), 

(2) 2[x^]7f T (x A ) -S[x^]7f T (x A ) = C. 

where the first sum is over all j3 such that x^ is in 7f T (x A ) and [x 7 ]7fj(x^) = 1, and the 
second sum is over all a such that x^ 1 is in 7f T (x A ) and \i has the form 

• if 7i 7i+lj then fi = Si(^) — ra% for some < r, 

• if 7i < 7i+lj then jjl = 7 — rc^ /or some < r. 

Proof. Suppose x 7 is in 7f SiT (x A ) with some coefficient c, where c is necessarily positive. 
By the definition of 7Tj and the description of its action given in (|3.4p . we must have 7 = 
/3 — tcti for some /3 such that /3j > and x' 3 in 7f T (x A ). Clearly, < i < (/% — fy+i). 

To show (2), first suppose ji 5* 7j+i- Clearly X![ x ]^V( X ^) c > where the sum is 
over all /3 such that x' 3 is in 7f T (x A ) and [x 7 ]7Tj(x' 3 ) = 1. The only monomials x^ in 
7f r (x A ) which have [x 7 ]-7fj(x /i ) = —1 are those monomials with \i = 54(7) — ra{ and < r. 
Similarly if % < ji+i, the only monomials x M in 7f T (x A ) which have [x 7 ]7fj(x /i ) = —1 are 
those monomials with a = 7 — raj and < r. Thus if [x 7 ]7f SiT (x A ) = c, we must have 
2[x /3 ]7f T (x A ) - Xi[x M ]7f T (x A ) = c in both cases. 

Conversely suppose we have (1) and (2) of the lemma. Since each monomial x^ in the 
sum y , [x^]7f T (x A ) satisfies [x 7 ]7Tj(x' 3 ) = 1, and each monomial x^ in the sum Yj[x^]7Tv(x A ) 
satisfies [x 7 ]7fj(x^) = —1, we conclude [x 7 ]7f SiT (x A ) = c. □ 

Remark 3.1.4. Intuitively Lemma 13.1.31 says that x 7 is in 7f SiT (x A ) if and only if x 7 is 
in 7fj(x^) for some x' 3 in 7f T (x A ), and x 7 is not cancelled by terms coming from ^(x^ 1 ) for 
some x^ in 7f r (x A ). 

3.1.2. Keys. For the remainder of this section we will abandon the convention from 
Chapter [2] of using reverse tableaux. Thus all Young tableaux in this section will have 
entries which weakly increase from left to right in its rows, and strictly increase from top to 
bottom in its columns. We will continue to use the English convention of drawing tableaux. 
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In [32] , the authors use the notion of a key, which is a Young tableau whose sets of col- 
umn entries are ordered by containment, to give an alternate characterization of Demazure 
atoms ^4 t (a) • The definitions we present here follow |32j and |47j . 

Definition 3.1.5. A key is a semi-standard Young tableau such that the set of entries 
in the (j + l)st column form a subset of the set of entries in the j'th column, for all j. 

There is an obvious bijection between weak compositions and keys given by 7 = 
(71,..., 7„) —* key (7), where key{^) is the key of shape 7 whose first 7^ columns con- 
tain the letter j, for all j. For example, if 7 = (1,0, 3, 2, 0, 1), then 



1 
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4 
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The inverse of this map is given by T — > cont(T), sending a key T to its content. 

Knuth equivalence plays a crucial role in this section, so we reprise its definition from 
Section 12X21 

Definition 3.1.6. Let a, b, and c be positive integers. Then 

K,\ : bca — > bac if a < b < c 
K,2 ■ acb — > cab if a < b < c 

The relations JC\, K2, and their inverses /Cj~ , , act on words w by transforming triples 
of consecutive letters. We will say two words w and w 1 are Knuth equivalent, and write 
w = 1//, if and only if u; can be transformed to w' through a sequence of transformations 
using only /Ci, /C2, /C^ 1 , and K,^ 1 . 

Let T be a Young tableau and let w co [(T) be the column reading word of T, which is 
obtained by reading the entries of T in each column from bottom to top and from left to 
right. We will occasionally write w co i{T) = v^v^ ■ ■ ■ where each v^' is the strictly de- 
creasing word comprising the jth column of T. In general any word which strictly decreases 
will be called a column word. Similarly, let w row (T) be the row reading word of T, which 
is obtained by reading the entries of T in each row from left to right and from bottom to 
top. We will write w row (T) = ■■■u^u^ where each uW is the weakly increasing word 
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comprising ith row of T. In general any word which weakly increases will be called a row 
word. A standard fact about Knuth equivalence [52j is that there is a unique word v in 
each Knuth equivalence class such that v = w co i(T) for some Young tableau T. 

Let w be a word. The column word factorization of w, written w = w^'w^ ■ ■ ■ , is 
the factorization where each is a maximal column word. Denote by colform(w) the 
column form of a word w, which is the composition whose jth part is the length 
For example if w = 134214, then w = 1 • 3 • 421 • 4 is its column word factorization, and 
colform(u;) = (1,1,3,1). 

If a word w is equivalent to w co i(T) we will write w = T. Let w be an arbitrary 
word such that w = T where the shape of T is A. The word w is called column-frank if 
colform(u)) = A*; that is, if colform(u>) is a rearrangement of the parts of A*. 

Definition 3.1.7. ([47]) Let T be a Young tableau of shape A. The right key of T, 
denoted K + (T), is the key of shape A whose jth column is given by the last column word 
of any column-frank word v such that v = T and colform(w) = (. . . , A*). 

Example 3.1.8. Let A = (2,2,1,1). Then A* = (4,2). If 



T = 
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2 




2 
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5 





then Wcoi(T) = 532142. To compute K + {T) we can use the words v\ = 5321 • 42 and 
V2 = 32 • 5421. Then 



K + (T) = 



1—1 1 
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4 


4 




5 





Let a be a permutation written in one-line notation and let A be a partition. There 
exists a key K(a, A) associated to a and A which is defined by setting the jth column of 
K(a, A) to be the first Xj letters of a in increasing order. 

Our first characterization of Demazure atoms first appeared in [32]. Let a e S n / Stab(A) 
be a minimal length coset representative such that <r(A) = 7. 
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Lemma 3.1.9. f |32] ) The Demazure atom <A T (\) = 7r r (x A ) is the sum of the weights of 
all Young tableaux whose right key is equal to K(a, X t ). 

3.2. Nonsymmetric Macdonald Polynomials at q = t = and Column-Strict 

Composition Tableaux 

Following |26j and |50| . in |42| the author shows that Demazure atoms -4 t (a) are spe- 
cialized nonsymmetric Macdonald polynomials, where the author in [42] uses a version of 
the nonsymmetric Macdonald polynomials studied in |40j . See Chapter [J] for details on 
nonsymmetric Macdonald polynomials. 

Theorem 3.2.1. ^ [42] ) The Demazure atom Ay(x±, . . . , x n ) = 7f T (x A ) is equal to the 
nonsymmetric Macdonald polynomial E^{x\, . . . , x n ; 0,0) at q = t = 0, where r(A) = 7. 

The proof of this theorem relied first on classifying the fillings of diagrams in the com- 
binatorial formula of i£~(x;0, 0) as so-called semi-standard augmented fillings, or SSAF. 
Then the author provided certain bijections to Young tableaux to establish Theorem 13.2.11 
These semi-standard augmented fillings of shape 7 are defined as non-attacking augmented 
fillings of dg(7) such that there are no descents and every triple of Type I and Type II is 
an inversion triple. The reader can find the definitions of these terms in Section 14.21 

In a later work [21J the authors give a bijection between semi-standard augmented 
fillings and column-strict composition tableaux. The reader should compare the following 
definition to Definition 12.1.51 

Definition 3.2.2. Let a be a strong composition with k parts and largest part size m. 
A column-strict composition tableau (CT) U is a filling of the diagram a such that 

(1) The first column is strictly increasing when read top to bottom. 

(2) Each row weakly decreases when read left to right. 

(3) Triple Rule: Supplement U with zeros added to the end of each row so that the 
resulting filling U is of rectangular shape k x m. Then for 1 < i\ < ii < k and 

2 < j < m, 

(Ufa,j) * and U(i 2 ,j) > U(ii,jj) Ufa,j) > U(h,j - 1). 



3.2. NONSYMMETRIC MACDONALD POLYNOMIALS AT Q = T = AND 
COLUMN-STRICT COMPOSITION TABLEAUX 



48 



If we let U(i2,j) = b, U(ii,j) = a, and U(ii,j — 1) = c, then the Triple Rule (b and 
b ^ a implies b > c) can be pictured as 



c a 



Lemma 3.2.3. ( \21\ ) There exists a weight preserving bijection between column- strict 
composition tableaux of shape a and semi-standard augmented fillings of shape 7 such that 



7 + = a. 



Example 3.2.4. The following pair consisting of a column-strict composition tableau 
U of shape (1,3,2,2) and a semi-standard augmented filling V of shape (1,0,3,0,0,2,2) 
illustrates the bijection whose existence is claimed in Lemma 13.2.31 
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Given a composition 7, define the foundation of 7 as the set 
(3.5) Hi) = {i\li> 0}. 



The proof of Lemma 13.2.31 in |21j shows that semi-standard augmented fillings of shape 7 
are in bijection with column-strict composition tableaux whose first column consists of the 
entries ^(7). Now we can give another characterization of A T ^y 

Lemma 3.2.5. fl21] _) Let r(A) = 7. The Demazure atom is given by 

(3.6) A~ / =Y i * L 

u 



j j 



where the sum is over all column-strict composition tableaux U of shape 7 + whose first 
column is ^(7). 
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3.3. Composition Array Patterns 

In this section we first recall the classical bijection between Young tableaux and Gelfand 
Tsetlin patterns. We then give a characterization of -4 r (A) which parallels the construction 
in classical symmetric function theory of GT-patterns. In this section we return to our 
previous convention of using reverse Young tableaux. 

3.3.1. Definitions. Let A and [i be partitions such that fx <= A, that is £(fjt) ^ £(X) 
and fii < Aj for all 1 ^ i ^ £(fJ-)- A reverse column-strict Young tableaux of shape A/// is a 
filling of the boxes of the skew diagram X/fi such that each row weakly decreases and each 
column strictly decreases. 

A Gelfand-Tsetlin pattern of shape A is a triangular array GT^ = (xij) of positive 
integers such that Xij ;* Xi+xj 5* x i,j+i f° r an * an d j satisfying 1 < i ^ n — 1 and 
1 ^ j ^ n — i, where we use the indexing convention depicted below: 

xx,i ■■■ ■■■ ■■■ xx, n 

X n -2,X X n -2,2 

X n -X,l X n -x t 2 
Xn,X 

A standard fact j52| from combinatorics is that GT-patterns of shape A are in bijection 
with semi-standard Young tableaux. This bijection, which we will denote by (p, can be 
described within our definitions as follows. Given a GT-pattern GT^ the reverse column- 
strict Young tableau tp(GT^) is given as follows. Given a Ferrers diagram of shape A, fill 
the boxes of the skew shape 

\Xi^Xi Xi t 2i • • • > "Eijfi— i+l)/ {xi+l^i Xi+X,2i • • • > ^i+l,n— i) 

with the entry i. Given a reverse column-strict Young tableau T of shape A, the ith row 
of the array tp~ l (T) will be the shape of the resulting diagram when one deletes all boxes 
from T filled with entries strictly less than i. 

Let a and /3 be (strong or weak) compositions. Recall that we say a c j3 if £{a) ^ £((3) 
and o.i Pi for 1 ^ i < £{a). Let a* be the reversal of a. We write a <s= j3 if a* c j3*. 
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The following definition of skew composition shaped diagrams was first given in [7]. 
Given compositions a (s /?, the diagram of skew composition shape f3 '//a are the boxes that 
are in (3 but not in a when the diagram of a is positioned in the lower left corner of the 
diagram of (3. 

Next we will define the Gelfand-Tsetlin type triangular arrays which are in bijection to 
composition tableaux. 

Definition 3.3.1. Let 7 be a weak composition of length n. A composition array 
pattern of shape 7 is a triangular array Xn = (xi j) of nonnegative integers satisfying: 

(1) 7i = x ljh 

(2) «S Xi-ij+i, and 

(3) for all 1 < i < n — 1 and for all < r < s < n — i we have 

(xi+i,r Ss Xi+i, s and Xi+i, r > Xi, a +i) or (xi+i, r < Zi+i,a < Zi,s+i and Xi, r +i < £j+i jS ) 

where we understand Xj$ = for all j. 

Our first new characterization of Demazure atoms is given in the following theorem. 
The bijection tj) of Theorem 13.3.21 is illustrated in Figure 13.11 

Theorem 3.3.2. The set of column- strict composition tableaux of shape 7 + = a with 
first column ^(7) are in bijection with the set of composition arrays of shape 7. 

Proof. We need to construct a bijection ip mapping from composition arrays of shape 
7 to composition tableaux of shape 7 + = a with first column J-{^)- First we describe ip. 
Let X n be a composition array of shape 7. First create a diagram of shape x n \ and fill each 
box with the entry n. Then fill the boxes of (x n -± 1, x n -± 2)//(x n ) with the entry n — 1. 
Continuing inductively, fill the boxes of (a^i, . . . , Xj,n-i+i)//Ocj+i,ij • • • 1 x i+i,n-i) with i. 
This clearly creates a filling U = ip(X n ) of composition shape 7, where 7 + = a. Since the 
entries of the array X n satisfy x^j Xi—ij+i, then by construction the entries in the rows 
of U weakly decrease from left to right. It is also clear that the first column of U weakly 
increases top to bottom. 

To see that the first column actually strictly increases, we need to show that for any i 
there is at most one occurrence of i in the first column of U. Suppose that this is not the 
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case. Then for some i we have at least two occurrences in the first column, say is rows i\ 
and %2 with % < i\ < i<i ^ n. That means a^+i^-j = 0, Xi.^-j+i > 0, a^+i^-i = 0, and 
x i,i 2 -i+i > 0- But this is clearly in violation of the defining inequalities since Xj+i^-i = 
x i+i,i 2 -i = but Xj+i^-j = < Xi t i 2 -i + \. Note that this argument also shows that the 
entry U(i, 1) in row i and column 1 must be either undefined (in which case % = 0) or 
U(i, 1) = i. Thus the first column of U is ^(7) and strictly increases. 

Now we check that U satisfies the Triple Rule for column-strict composition tableaux. 
First we note that there can be at most one occurrence of i in any column j. To see 
this suppose it is not the case. Then for some rows i\ = i + k\ and 12 = i + k2, with 
ki < k 2 , we have x^ kl +i > j and x^ k2+1 j while x i+1)kl < j and x i+ i^ 2 < j- These 
inequalities violate the defining inequalities of the array. In detail: If Xi + \ )kl Xi + \ )k2 we 
have x i+Xykl < j ^ x iM+l . If x i+likl < x i+XM (and necessarily x i+XM < x iM+ i) we have 
Xi t k- L +i ^ j > Xi + i t k 2 - So this shows there is at most one occurrence of i in any column. 

Now we check the Triple Rule. Append zeros to the end of each row of U, as in Definition 
13.2.21 and call this filling U. Consider an entry b = U(i2,j)- Every entry in the same column 
as b is different than b, so the entry a = U(i\,j) (which may be zero) satisfies b ^ a. If 
b < a, then there is nothing to check. If b > a, then we have relations Xb,i 2 ~b+i > and 
^0,11-0+1 > in the array. 

Suppose that c = U(ii,j — 1) satisfies c ^ b. In the case where c = b, then we have 
Xch-c+i < x c ,i 2 -c+l, and £c+i,n-c < £ c ,n-c+i, and x c+ i ii2 „ c < x c> i 2 - c +i- The last two 
inequalities come from the fact that there is at least one entry c in both rows i\ and 
i2- Considering row c + 1 of X n , assume we have x c+ \^_ c ^ £ c +i,i 2 -c- Because X n 
satisfies all the appropriate inequalities, we must have £ c +i,u-c ^ £ c ,i 2 -c+i which clearly 
contradicts our assumptions that Xc+i^-c < £ c ,ii-c+i < £c,i 2 -c+i- Suppose instead we 
have Xc+x^-c < x c +i,i 2 - c - Note that x Ciil _ c+ i = j - 1, and x c +i,i 2 - c ^ j — 1- Because 
x c +i,h-c < x c+ i t i 2 - c we must have x Ctil - c+ i = j - 1 < x c+lti2 - c ^ j - 1, which is a 
contradiction. 

Now consider the case when c > b. Thus in the array, Xc^-c+i > 0. Since c > b and 
appears in column j — 1, we must have x c ,u-c+i ^ x c ^ 2 - c+ \. By the definition of the array, 
we then have x c ^ x - c +\ ^ £ c -i,i 2 -c+2- Since c > b and a < b and c and a are adjacent in 
the diagram U, we know then that x Ctil - c+ x = x c _i i i 1 _ c+2 . Thus x c -i,i 1 - c +2 > x c -i,i 2 -c+2- 
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This in turn forces x c _i iil _ c+2 > x c ~2,i 2 -c+3- Again we have x c _i i i 1 _ c+2 = x c ^ 2 ,h-c+3- 
Thus s c _2,i 1 - c +3 3 s 2; c -2,i 2 -c+3- Continuing in this way, we eventually see a^+i^-ft = 
x c ,h-c+i > Xb+i,i 2 -b, which forces x 6+1)il _& = x Ciil _ c+ i ^ x 6ji3 _ 6+1 . Thus it is impossible 
for an entry 6 to be in column j with a < b while an entry c > b is in column j — 1. This 
proves that the Triple Rule is satisfied. 

Now to describe the inverse . Given a column-strict composition tableau U of shape 
7 + = a with first column J-(j), expand the diagram to the weak composition shape 7 
according to the bijection in Lemma 13.2.31 Thus the diagram has shape 7, where 7 has 
length n =(maximum entry in U), and where {i | 7j > 0} = {U(i, 1) | 1 < i < and for 

j e {i I 7j > 0} we have 7j = a,-. 

Now construct the array X n as follows. The nth row of X n will be the number of 
boxes containing n in the last row of U. Note that n can only appear in the last row. The 
(n-l)st row of X n will be the weak composition {xji— 1 1, x-n— l 2 

) where x n _i i is the number 

of (n — l)'s in the (n — l)st row and 

Xn— 1,2 = l + (the number of entries n — 1 in row n). 

By construction x n> i $5 aj n _i 2- Because J7 is a column-strict composition tableaux and thus 
satisfies the Triple Rule, we know that in the case x n \ < x n —i t 2 we have x n —i t i < x n \. 
This is one of the defining inequalities for when i = n — 1, r = and s = 1. 

Continuing inductively, suppose we have constructed rows i + 1, i + 2, . . . ,n of the array 
X n and each of these rows satisfy the defining inequalities of a composition array pattern. 
The ith row will then be the weak composition (scj i, . . . , £j )n ,_j + i), where 

Xij = Xi+ij—i + (the number of entries i in row i + j — 1). 

We now need to show that row i of X n satisfies the correct inequalities with row % + 1. By 
construction, Xj+i j ^ Xij+i. Now assume we are in the case where, for 0^r<s<n — i, 
we have Xj+i r > Xj+i jS . In terms of the filling J7, this relation means that if we look at the 
truncated portions of rows % + r and % + s which contain entries ^ i + 1, then the length 
of the truncated row i + r is weakly greater than the length of the truncated row i + s. 
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Because U satisfies the Triple Rule, we know that the number of i's in row i + s cannot 
exceed the length of the truncated row i + r. Which is to say > X£, s +i- 

Suppose now we are in the case Xi+± >r < Xi + \ jS < Xi >s+ ±. In terms of the filling U, the 
relation Xi+i jT < Xj+i s mean that the length of the truncated row i + r (again, consider 
only the portion of the row with entries ^ i + 1) is strictly shorter than the length of the 
truncated row i + s. The relation Xi + \ )S < Xi tS +i means there is at least one i in row i + s. 
Since U satisfies the Triple Rule, the number of Vs in row i + r is strictly bounded by the 
length of the truncated row i + s. That is £j >r -+i < x i+i,s- 

Finally, we see that 7, = xn by construction. Thus the array X n satisfies all the defining 
relations for a composition array pattern. Therefore we have the required bijection. □ 

Remark 3.3.3. If we take the set of all composition arrays of shape 7 where 7 + = a for 
some fixed strong composition a, then Theorem 13.3.21 can be viewed as a bijection between 
column-strict composition tableaux of shape a and composition arrays of shape 7 with 
7 + = a. 
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Figure 3.1. Instance of the bijection from SSAF to composition array patterns 

In |41] the author describes a bijection, which we denote 6, between semi-standard 
augmented fillings whose shape is a rearrangement of A and reverse column-strict Young 
tableaux of shape A. The latter are partition shaped diagrams filled with positive integers 
such that the entries in each row weakly decrease when read left to right, and the entries 
in each column strictly decrease when read top to bottom. 

In light of Lemma f3.2.3l we can describe the bijection 6 as follows. Given a column-strict 
composition tableaux U, the ith column of 9(U) is defined to be the ith column of U in 
strictly decreasing order. The inverse # _1 is given as follows. Given a reverse column-strict 
Young tableaux T, the first column of _1 (T) is the first column of T in increasing order. 
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Then place the entries of the ith column of T, starting with the largest entry, in the highest 
row of the leftmost column whose rightmost entry is weakly greater. 

Example 3.3.4. Below is an example of the bijection 8. 
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One natural question to ask is how to define 6 on composition array patterns such that 
the image is a Gelfand-Tsetlin pattern. Let us define the map O acting on composition 
array patterns to be the map which sorts the ith row of a composition array pattern XZ 
into weakly decreasing order. Also define O to be the map which transforms a GT-pattern 
GT* into a new triangular array by the following procedure. First, O fixes the nth row of 
GT^. Then, inductively, O takes the entries of the ith row of GT^ from least to greatest 
and places then as far to the right as possible, such that if the entry bj from row i is placed 
at coordinates (z, k), then the entry at coordinates (z + 1, k — 1) is weakly less than bj. If 
no such coordinates (i,k) with k > 1 exist, place bj in coordinate (i, 1). Thus the entries 
from row i of GT^ are, from least to greatest, placed as far to the right as possible so that 
the columns running in the north-east direction weakly increase. 

The map O is well-defined for the following reason. Consider two consecutive rows 
z — 1 and z of GT^. In row i — 1 index the entries from left to right so that a\ ^ 02 S> 
a 3 ^ • • • . Similarly, in row % index the entries so that b\ ^ 62 ^3 ^ • • • . Because 
GT^ is a GT pattern, we have by definition a, ^ bj ^ cti+i- To show is well-defined 
we need to show that after inductively constructing rows n, n — 1, . . . , i, and after placing 
a-n-i+2, a-n-i+i, ■ ■ ■ , hi the new array, the element a,j in row i — 1 of GT^ can be placed 
in a well-defined position in 0(GT„). 

If we assume rows n,n — 1, . . . , i of O(GT^) have been constructed, then we can place 
elements a n -i+2, fln-i+i, • • • , o-i+i in a well defined-position up to some entry a/, where a\ is 
the first entry in our inductive process in row i — 1 which is strictly less than all the entries 
Xi t k-i adjacent to each unoccupied coordinate (z — 1, k). If ai is as just described, we place 
ai in coordinates (i — 1, 1). To show is well-defined, it suffices to show inductively that 
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after placing entries ai-±, ai-2, ■ ■ ■ , Oj+i in well-defined positions, the entry aj, with j < I, 
satisfies Xi^-i < aj for at least one unoccupied coordinate (i — l,k). 

To prove this claim, recall that a\ is placed at the coordinate (i— 1, 1) because a; is strictly 
less than the entries Xi^-i adjacent to each unoccupied coordinate k). If some a s , with 
s > I, is adjacent to a b q with q < I, then there exists an unoccupied coordinate (i — l,t), 
with t > 1, such that xi s t—\ = b p for some p ^ I. Thus a; 5 s 6; 5 s 6 P , contradicting the fact 
that a; is strictly less than the entries x^k—i adjacent to each unoccupied coordinate. Thus 
at the time a; is placed in coordinates (i — 1,1), all the remaining unoccupied coordinates 
(i — 1, k) have x^-i — b q for q < I. 

We clearly have \{b q \ q < l}\ = \{a r \ r < l}\. At the time ai is placed in coordinate 
(i — 1, 1) any entry a;_ r , where 1 < r ^ I — 1, will be greater than or equal to r entries a^fc-i 
adjacent to the unoccupied coordinate (i — 1, k); namely a;_ r ^ 6;_ r ^ r +i ^ • • ^ 
After inductively placing each entry a;_ r at most one more of the coordinates adjacent to 
one of b[_ r , bi- r+ i, . . . , gets occupied. So at any time j = I — r, the entry Oj is greater 
than or equal to at least one entry Xi^-i adjacent to an unoccupied coordinate. Thus at 
each step in our inductive process, there is always a well-defined position for each entry aj, 
and so the map O is well-defined. 

Theorem 3.3.5. The map O is a bijection, with inverse O -1 = O, between composition 
array patterns of shape 7 and Gelfand-Tsetlin patterns of shape 7 = A. Moreover, the 
following diagram commutes: 

A B 



C D 

where A is the set of composition array patterns of shape 7, B is the set of Gelfand- Tsetlin 
patterns of shape 7 = A, C is the set of column- strict composition tableaux of shape 7 + with 
first column ^(7), and D is the set of reverse column-strict Young tableaux of shape 7 = A. 

Proof. Recall that O is the map which sorts the rows of XZ into weakly decreasing 
order. First we will show that, given a composition array pattern XZ, the image ®{XZ) is 
a Gelfand-Tsetlin pattern of shape 7 = A. 

Consider two consecutive rows i — 1 and i of XZ- In row i — 1 let aj be the jth largest 
entry so that a\ ^ a<i ^ 03 ^ • • • . Similarly, in row i let bj be the jth largest entry so that 
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b\ > 62 ^ ^3 ^ • • ■ • To show that Q(X2) is a GT-pattern we need to show cjj ^ 6j ^ Q>j+i 
for all 1 < ,7 < n — i. 

First we show aj ^ For the case j = 1, since ai is the largest entry of row i — 1, 
if ai < 61 then 61 = Xi >si ^ Thus a\ < b\ ^ which is a contradiction. 

Now assume j ^ 2. Consider b k for 1 < A; < j. Let 6/; = Xj jSfc . Then if any = Xi )Sk has 
some a; = Xj_i )Sfe+ i with Z ^ j then ^ a; ^ 6jt ^ 6j. Thus we may assume 

{xj_i iSfc+ i I x itSk = 6 fc for some 1 s; k < j} = {ai, a 2 , ■ ■ ■ , Oj-i}- 

Thus 6j = Xj )Sj must have a; = a^-i^+i with Z ^ j. Thus aj ^ ai ^ bj. 

Next we will show 6j ^ For the case j = 1 we proceed as follows. Suppose 

fri = a?ir an d ai = s for some r < s, that is a\ is strictly right of b\ in the composition 
array pattern XZ- Since b\ ^ then we must have b\ > oi, and hence 61 ^02. 

Suppose instead 61 = Xj jr and ai = Xj_i ir+ i, that is ai and b\ are adjacent in X^. If 
<22 = s is strictly to the right of a\ in row i — then since b\ ^ a^s+i we have b\ ^ a 2 . 
If a2 = Xi-\ s is strictly left of a\ in row i — 1, that is s < r, we have three cases. For the 
first case, suppose < b\ < a±. Then b\ > a2 by (3) of Definition 13. 3. 11 For the second 

case suppose x i s _i <b\ = a\. Then b\ = a\ ^ a 2 . For the third case suppose x ijS ^i = b\. 
Then b\ = ^ a\. This 61 > 02- For the case where 61 = Xj jr , a2 = and 

ai = Xi^\ )S with s < r, we can repeat the previous three cases with the roles of a\ and 
switched. 

To finish showing b\ ^02, we need to consider the case when both a\ and a2 are strictly 
left of b\ in XZ- Let b\ = Xi^ r . We may assume that a\ is to the left of a2, and 02 is to 
the left of Xj_i jr+ i, because the case when a2 is to the left of a\, and a\ is to the left of 
Xi-i,r+\ can be completed by reindexing the present case. Let a\ = Xj_i jSl and 02 = x.;_i jS2 , 
with s\ < S2- We wish to consider the elements Xj jSl _i := b kl and Xj iS2 _i := b k2 in the 
following three cases. For the first case, if b kl ^ 6fc 2 then we have b kl ^ 02- Thus we 
have 61 5= bkj ^ a2. For the second case, suppose 6/ Cl < bk 2 < ci2- Then b^ 2 > a\, from 
which it follows that b\ ^ bk 2 > a\ ^0,2- For the last case, if b kl < bk 2 = a.2 then clearly 
bi ^ b k2 ^ a 2 . 
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Next we show bj ^ a j+i f° r j 5 s 2. Let 

{xi, Sk | ai = Xj_i jSfc+ i for some 1 ^ I ^ j + 1}. 

Then by the pigeonhole principle, Xj jSfc = 6^ with k > j for at least one element in this set. 
If bk is to the right of bj in XZ, then 6j = Xj )S . ^ bk = Xi, Sfe implies bj ^ a/ := Xj_i iSfc+ i 
where 1 < I ^ j + 1. Thus 6j ^ a/ ^ as needed. 

If instead 6^ = Xj jSj , is to the left of bj = Xi jSj in XZ then we have the following. Let 
CL r = Xj_l >s +1 and assume b k < bj < a r . Then bj > Xj_i jSfc+ i = a/ where 1 ^ I ^ j + 1. 
This implies a contradiction in the case when 1 < I < j. In the case I = j + 1 we have 
bj > aj + i as needed. 

Next, assume bk < bj = a r . If r ^ j + 1, then 6j = a r ^ gu+i- If r > j + 1, then at least 
two elements of the set 

{a, | 1 < * < J + 1}, 

say a h := Xj_ 1)Sl+1 and a^ 2 := Zj-i^+i, must have x^ Sl := b kl and x iiS2 := b k2 with /ci > j 
and &2 > i- If either b kl or 6fc 2 appear to the right of bj in X2, then 6j ^ b ki forces 
bj ^ a,/ - ^ flj+i- Thus we may assume both b kl and are to the left of bj. Let us first 
assume b kl is left of b k2 is left of bj. With this arrangement, if b kl ^ b k2 then b kl a; 2 - 
Since bj 2= 6^ and a/ 2 > a_j+i we get bj > Oj+i- If instead b kl < bk 2 < ai 2 then bk 2 > ai x . 
Thus bj > (ij + \. Finally, if b kl < b k2 = ai 2 then bj ^ b k2 = ai 2 > flj+i- The arrangement 
when bk 2 is left of b kl is left of 6j is exactly analogous. 

The last case to consider is when b k = bj. Then we have b k > a r . If r ^ j + 1 then 
6j = b k ^ a r Oj+i- Now assume r > j + 1. As in the previous paragraph we must have 
elements a/ 1 and ai 2 , with li ^ j + 1, and elements 6/ Cl and b k2 diagonally adjacent to a/ 1 
and d[ 2 , with fcj > j. If either 6/ 0l or bk 2 is right of 6j, then bj ^ 6^ forces bj ^ > flj+i- 
Thus we may assume both b kl and bk 2 are left of bj. Examining the same cases as in the 
previous paragraph proves bj ^ dj+i- 

Thus O maps composition array patterns to Gelfand-Tsetlin patterns. Next we show O 
is a bijection by showing O = _1 . 
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First we show that @(GT£) is a composition array pattern. Relations (1) and (2) of 
Definition 13.3. II are satisfied by construction. It remains to be shown that the two relations 
in (3) of Definition 13.3.11 are satisfied. 

Suppose bj := Xi + i :T >; bk '■= £i+i, s with r < s in Q(GT^). By the definition of the map 
O we have j < k. Define a q := £i, r +i and a p := Xi tS +i- If p ^ j + 1 then bj ^ a j+i ^ %>> as 
needed. If instead p < j + 1, then q < p by the definition of O. Considering the sets 

{ai,...,Op_i} and {b u . . . , 6 p _i} 

and noting that a g is already adjacent to bj, we see that by the pigeonhole principle there 
must be at least one := x^, with ti > p, such that b qi := Xi + \j 1 -\ has q± < p. 
Considering now the two sets 

{oi, . . . i<Hx-i) and {h, ■ . . , b tl -i} 

we again use the pigeonhole principle to get at least one aj 2 := Xi j 2 , with t2 > t\, such that 
b q2 := Xi+ij 2 -i has qi < t\. We can continue in this way until we get some at k := Xij. , 
with tk > j ife-i, such that b qk := Xi+ij k -i has q^ < t^—i «c j. These relations forces the 
equality b qi = a tk . In particular, bj = a p as needed. 

Now assume Xj+i, r < Xj+i jS < Xj^+i. Then we must show Xj+i )S > x^r+i- Let 6^ = 
Xi + i <r and 6j = Xj + i jS . Since 6^ < 6j, we have fc > j. Let Xi :S +i = a p and let £j jr +i = a<j- 
If jP s> J + 1 then 6j cij+i a p from the GT pattern. But we also have 6j < a p by 
assumption which produces a contradiction. Thus we may assume p < j + 1. If g 5 s A; + 1 
then 6/c ^ a^+i > a g from the GT pattern. Since bk «S a g by assumption, we get 6^ = a g 
and hence bj > a q as needed. 

Next consider when p<j + l^q^k. Then bj > Oj+i 5 s &q from the GT pattern. 
Because p < q, in constructing O(GT^) the entry a g would have been placed before a p . 
If 6j = a g then the entry a q should have been placed at coordinates (i,s + 1) instead of 
(i,r + 1), contradiction our assumptions. Thus we have bj > a q as needed. 

We are now in the case when both p and q are both strictly less than j + 1. If p < q < j 
then 

a r , ^ a a ^ a,- ^ 6,-. 
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Again we have, since p < q, the entry a q is placed in O(GT^) before a p . Since a q 2= bj, the 
entry a q should have been placed in coordinates (i,s + 1), contradiction our assumptions. 
The final case to consider is when q < p < j. Consider the two sets 

{ax, . . . ,a p -x} and {&i, . . . , & p _i} 

and note that since a q is already adjacent to bk by assumption, the pigeonhole principle 
guarantees at least one entry := Xij 1 , with t\ > p, such that b qi := Xi+i^-i has q\ < p. 
Considering now the two sets 

{ax, . . . ,a tl -x) and {bx, . . . , b tl -x}- 

We can use the pigeonhole principle again to get at least one aj 2 := Xij 2 , with ti > tx, such 
that b q2 := Xi+ij a —i has q2 < tx- We can continue in this way until we get some at h := Xi,j h , 
with tk > j > ifc-i, such that b qk := Xi+x,j k -i has qk < ifc-i «S j. These relations forces the 
equality b qi = at h . In particular, bj = a p , which is a contradiction. 

Thus, the map O maps Gelfand-Tsetlin patterns to composition array patterns. Clearly, 
the composition Oo@ is the identity on GT patterns. Hence O is injective and O is surjective. 
To show O is injective, we will show 9 = ip o © o ip^ 1 which will also show that the diagram 
in the statement of Theorem 13.3.51 commutes. 

Recall that the bijection 6 mapping between column-strict composition tableaux and re- 
verse column-strict Young tableaux sorts the column entries of a column-strict composition 
tableau U into decreasing order to form a reverse column-strict Young tableau 9(U) := T. 
Hence 9 preserves column entries in U and T [21J. That is, a positive integer i is in column 
j of U if and only if i is in column j of 9(U) = T. 

By the definition of the map ip, a positive integer i is in column j of a column-strict 
composition tableau if and only if there exists an entry Xi ^ ~>- j in such that 

k-i < j- Since an entry i can appear at most once in any column of a column-strict 
composition tableau U, we can use the method of skew composition diagrams and if) to 
see that if there exists an entry j in ip^ 1 ^) such that Xi+xk—l < h then any other 

Xi t y > j must have x i+ x,k>-i > j- 
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The same can be said for reverse column-strict Young tableaux. That is, a positive 
integer i is in column j of a reverse column-strict Young tableau T if and only if there exists 
an entry y^i of the GT pattern <£> _1 (T) with y it i > j and t/i+xj < j, where we understand 
Vi,n-i+2 = for all i. 

Let U be a column-strict composition tableau. By the reasoning above, to show 9 = 
ip o @ o ip^ 1 , it is enough to show 

(3.7) x^k 2= j and a^+i^-i < j for some k in (U) 
implies 

(3.8) yij ^ j and y i+ ij < j for some I in (0 o ^ _1 )(?7), 

which in turn implies a positive integer i appearing in column j of (ip o o )([/). The 
fact that (|3.7p implies f|3.8|) can be readily checked through a parity argument which we 
presently describe. 

If we assume for some k that Xjfe ^ j and Xj+i < j in -(/j -1 ([/"), then any other 
x «,fc' 5 s J in ip~ l (U) must have Xj+i^-i > j (again, this is because the set of entries in any 
column j of a column-strict composition tableau U are distinct). Thus we have 

\{xi,t 3 s j I %i,t in V -1 ^)}! - \{xi+i,t > j I %i+i,t hi V _1 (^)} = 1- 

Thus, in the GT pattern (0 o ijj~ l )(U) where we sort the entries of ^ _1 (C/), the right most 
occurrence such that y^i > j in (0 o ^ _1 )(C/) must have yi+ij < j- Thus there exists a 
positive integer i in column j of (<fi o o ip~ l )(U). 

Thus we have shown (</> o o ^~ 1 )(f/) is a reverse column-strict Young tableau whose 
column entries are exactly those of U. Thus, ((f) o o -0 _1 )(L r ) = 0(U). 

□ 

3.4. Lakshmibai-Seshadri Paths 

The following definitions hold for symmetrizable Kac-Moody algebras |36j |37j . but 
since we are interested in type A objects, namely Demazure atoms, we will give all of our 
definitions in this specific case. 
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Fix a partition A, and as above let S n denote the symmetric group on [n] and Stab(A) 
the stabilizer of A. We can identify S n / Stab(A) with the subset of S n consisting of elements 
lo such that usi > u for all simple reflections Si such that (A, oti) = 0; these elements uj are 
exactly minimal length coset representatives for S n / Stab(A) |25j . Let X denote the weight 
lattice of sl n+ i and define := X ®z R. Define the pair (r; a) as 

(3.9) t : ti > ■ ■ ■ > r r 

(3.10) a : = ao < a\ < ■ ■ ■ < a r = 1 

where r is a strictly decreasing (in Bruhat order) sequence of elements in S n / Stab(A) and 
a is a strictly increasing sequence of rational numbers. 

As in [36], we will identify the pair (r; a) with a piecewise linear map tt: [0, 1] — ► Xr, 
and write it = (r , a) , defined by 



We will call tt a rational path of shape A. This map tt is a path in X^_ which starts at and 
moves initially in the direction of ti(A) for a\ units, then moves in the direction of T2(A) 
for <22 — a>i units, and so on. We will call 7r(l) the weight of tt. 

Definition 3.4.1. Let r and a be in 5 n /Stab(A) with r > a, and let a e Q with 
< a < 1. An a-chain for the pair (r, <r) is a sequence of elements kq, ki, . . . , k s in 
S' n /Stab(A) such that 

(1) T = Kq > K\ > ■ ■ ■ > k s = a, 



(3.11) 




for t e [a,-_i, Oj], where j = 1, . . . , r. 



(2) = £(Kt_i) - 1, and 

(3) o< Ki (A),ft>eZ, 



where the /3j are positive roots such that Ki = s^k^i. 



We can now give the crucial definition in our final characterization of Demazure atoms. 
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Definition 3.4.2. The rational path tt = (r;a) of shape A is called a Lakshmibai- 
Seshadri path (LS-path) of shape A if for all i, 1 < i ^ r — 1, there exists an ai-chain for 
the pair (rj,r i+ i). 

Notice that by definition, if tt is a LS-path then vr(l) is in X. Denote by n(A) the set 
of all LS-paths of shape A. If ir = (uj_;a) is an LS-path of shape A with to : uj\ > ■ ■ ■ > ui r , 
we define 

(3.12) n T (A) = {vr = (w;a) e n(A) | r ^ wi}, 

(3.13) fi T (A) = {vr = (uj;a) e 14(A) | r = ut}. 

The subset II T (A) is the set of all LS-paths tt of shape A that begin in the direction u>i(A) 
where r ^ uj\, and the subset IT- (A) is the subset of all LS-paths tt of shape A which begin 
in the direction r(A). 

In |36] the author shows that the Demazure character 7r T (x A ) is equal to 2 x7r ^\ where 
the sum is over all paths in II r (A). In the remainder of this chapter we will prove the 
following, which is our last new characterization of Demazure atoms. 

Proposition 3.4.3. With the notation above, 

(3.14) 7t T ( X x ) = A TW (x 1 ,...,x n )= J] x^ 1 ). 

7reft T (A) 

That is, the Demazure atom 7f r (x A ) is the sum of the weights of all LS-paths beginning in 
the direction r(A). 

To prove Proposition 13.4.31 we first need to define the root operators of Littelmann |36j . 
Let tt be an LS-path and for a fixed simple root a, define the function h a : [0, 1] — > IR by 
t >— * (7r(t),a). Define Q to be the absolute minimum attained by the function h a and let 
P = h a (l) — Q. Notice that P ^ and since h a (0) = we must have Q ^ 0. Since tt is 
a piecewise linear path, the minimum Q must be attained at some value t = ctj for some 
i, where 1 < i ^ r. Let p be maximal such that ^ p ^ r and h a {a p ) = Q and let q be 
minimal such that ^ q ^ r and h a {a q ) = Q. 

If Q ^ — 1, let y < p be maximal such that h a (t) ^ Q + 1 for all t ^ a y . Similarly, if 
P ^ 1 let x ^ p be minimal such that h a (t) ^ Q + 1 for all t ^ a x . For any simple root 
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a, Littelmann defines operators e a and f a which act on LS-paths ir. The author, having 
defined e a and f a in a more general context, gives the following as a proposition in [36] . 
Since we are in the finite type A case, we present the following as our definition for the 
action of e a and f a . 

Definition 3.4.4. ([36] Proposition 4.2) 

(1) If P > 0, then / q (tt) is the LS-path 

{t\ , . . . , Tp—\ , S a Tp^\ , . . . , Sq-Tx, T x + \ , . . . , T r , O0; • • • j dp— lj j • • • j Or ) ; 

if h a (a x ) = Q + 1 and s a Tp + i = r p ; 

(Tl , . . . , Tp, S Q Tp^_l , . . . , S a T X i T x + 1 , • • • , T r , Of); • • • > Q-r) ? 

if h a (a x ) = Q + 1 and Sq,t p+ i < r p ; 

(ti , . . . , Tp—\ , SaTp+i , . . . , S a T x , T x , . . . , T r , Q.(), • • • , Op— 1 , Op+1 5 • • • > O-x— 1 5 O, Ox j • • • Q>r) 1 

if h a (a x ) > Q + 1 and s a Tp + i = r p ; 

, . . . , Tp, S Q Tp4-i , . . . , S a T x , T x , . . . , T r , Q-o, • • • , O^- — 1 , (2, Q.^ , . . . , O r ) , 

if h a (a x ) > Q + 1 and s a Ty, + i < r p ; 

where a^-i < a < a x is such that h a (a) = Q + 1. If P = then / a (vr) = 0. 

(2) If Q < then e Q (vr) is the LS-path 

, . . . ,Ty, S a Ty+i, . . . , S a Tq, Tq+2 j • • • > *7"r j Of), • • • , Oq, Og+2 j • • • > O r ) , 

if h a (a y ) = Q + 1 and s Q T g = r g+ i; 

(Tl , . . . , Ty , SQ,Ty_|_i , . . . , S a Tq, Tg_|_l , . . . , T r , Q.(), • • • 5 O r ) , 

if h a (a y ) = Q + 1 and s Q T g > r g+ i; 

(Tl,... 

if h a (a y ) > Q + 1 and s Q r g = T q+ \\ 

{t\ , . . . , Ty_|_i , SoTy-i-i , . . . , S a Tq, Tq+l , . . . , T r , Of); • • • > Oy , O, Oy-f 1 , . . . , O r ) , 

if h a {a y ) > Q + 1 and s q t,j > t ?+ i; 
where a y < a < a y+ \ is such that /i a (a) = Q + 1. If Q = then e Q (-7r) = 0. 
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In [36] it is also shown that if f a (Tr) =£ then / Q (7r)(l) = 7r(l) — a, and if e a (7r) ^ then 
e a (7r)(l) = 7r(l) + a. Observe that Definition 13.4.41 shows that if tt is an LS-path beginning 
in the direction of Ti(A), then / a (vr) will be a path beginning in either the direction Ti(A) 
or s a Ti(X). The latter case occurs if and only if p = 0. When j> = 0, then h a (t) > for all 
< t < 1. In particular, h a {a\) = (ctiTi(A) , a) > 0. Thus (ti(A),q) > 0, hence s a ri > n. 

Let 7r be an LS-path beginning in the direction T\(X) and assume e a {ir) = 0. Fur- 
thermore, assume f a (ir) and f a (ir) is an LS-path beginning in the direction Ti(A). 
Then we claim /q(vt) is either or an LS-path beginning in the direction Ti(A) for all 
k ^ 2. If the claim is false, then there exists some k such that /q(vt) begins in the di- 
rection Ti(A) but /o +1 ( 7r ) begins in the direction s a Ti(X). Thus p = for /^"(vr), and so 
Q = /i Q (a p ) = M0) = 0- Th us e Q (/^(vr)) = 0, which is a contradiction. 

As above, let tt be an LS-path beginning in the direction ri(A) and assume e a (Tr) = 0. 
Now assume / Q (vr) and / a (vr) is an LS-path beg inning in the direction Sq, ti(A). Then 
we claim /^(tt) is either or an LS-path beg inning in the direction s a ti(A) for all k ^ 2. 
To prove this, again suppose the claim is false. Then as above there exists some k such that 
/q(7t) begins in the direction s a Ti(X) but /„ +1 (7r) begins in the direction Ti(A). Again we 
conclude Q = for /q(vt), and thus e Q (/^(7r)) = 0, which is a contradiction. 

The previous two paragraphs show that each LS-path in a given a-root string all begin 
in the same direction, except for possibly the first path in the a-root string. 

We now have the tools to prove Proposition 13.4.31 

PROOF of Proposition 13.4.31 Fix A a partition. We will induct on the length of the 
permutation r e S^/ Stab(A). When r = e is the identity, 7f T (x A ) = x A , and there is only 
one LS-path tt of shape A beginning in the direction A. This path is given by r : e and 
a : < 1. Clearly vr(l) = A. 

Let Si be a simple reflection such that £(sir) > £(t) and s,r e S n / Stab(A). Assume the 
inductive hypothesis that 7f r (x A ) = Yi ne f[ (a) x?r( ' 1 ' > - For any fixed tt' e II T (A) let m be the 
maximal integer such that /^(vr') ^ 0. By Definition I3.4.4| 



(3.15) 




for all ^ t ^ m. 
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Let tt e II SiT (A). Then since h ai {a\) = (Tt{a{),a.i) = ai(sjr(A), 04) < 0, we have Q < 0. 
Thus e ai (7r) =£ 0, and e ai {Tr) begins in either the direction r(A) or the direction Sjr(A) by 
Definition [3A4l In the former case, tt = f ai {^'), where tt' = e ai {n) e IT r (A) and e ai {iT') = 0. 
If we are in the latter case, Q < for tt' and so e a (7r) ^ 0. Thus tt' := e^, (tt) begins in either 
the direction r(A) or in the direction Sjr(A). Repeat this process the maximum number of 
times, so that we can write e a . {tt) = tt' where tt' begins in the direction r(A) and Q = for 
tt'. Thus every path tt e Tl SiT (\) can be written as f a .{iT') for some tt' e IT- (A) and some 
integer t > 0, with Q = for 7r'. 

Let 7r e Il SiT (A) and set 7r(l) := 7. By the last paragraph, tt = fa {it') for some 
tt' e n r (A) and some < t < (7r'(l),aj) and Q = for 7r'. Thus 7r(l) = 7r'(l) — ta^. But 
since 7r' e II r (A), we have x w W is in the Demazure atom 7f r (x A ) by the inductive hypothesis. 
Furthermore, since Q = for tt 7 and f ai {Tr') ¥= 0, we have for tt' 

< P = h ai {l) - Q = h ai {l) = (TT'{l), ai ) 

Thus if we set ft = tt'{1), then /3, > and [x 7 ]7fj(x^) = 1. Thus condition (1) of Lemma 
I3.1.3l is satisfied. It remains to be shown that condition (2) of Lemma [3. 1.31 is also satisfied. 

Now we want to look at all the paths tt' e IX,. which, after some number t of applica- 
tions of f ai yield /q,.(7t')(1) = 7. By the inductive hypothesis we have a correspondence 

I ^ is in vf r (x A ) and [x 7 ]^^) = 1} 

~ {tt e fi SiT (A) I tt(I) = 7} u W e U T {\) | 4(vr')(l) = 7 for some tj^ir') e U T {\)}. 
Given a path 

(3.16) tt' e {tt' e fi T (A) | 4(tt')(1) = 7 for some tj^n') e U T {X)} 

we may map it bijectively to a path r/ e II T (A) such that 77(1) = \jl for some \i in the sum 
J][x /i ]7f T (x A ) where [i is as in Lemma 13.1.31 and this can be done as follows. The path 
tt'q satisfies (^(l),*^) > by virtue of the correspondence above. Let k be maximal such 
that e k ai {TT' ) / 0. Set <j> = <e*.(^)(l), oa) and let r) = /&~ 2fc (7t£). The path 77 = /^K) 
is non-zero and begins in the direction r(A) by the discussion immediately preceding this 
proof; that is, tt' = f a .{Tr') for some t and some tt' , and both tt' and tt' begin in the same 
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direction r(A). Then ij is a path such that r](l) is a weight satisfying x^ 1 ) is in 7f T (x A ) and 
[x 7 ]7fj(x r ' ( ' 1 - ) ) = —1. Conversely, given any r/ contributing to the sum J][x^]7f T (x A ) we may 
map it to an LS-path tt' as in 13.101 as follows. Let I be maximal such that f^iv) ^ an d 
set e = O^faXlW- Now let tt' = e^(r?). 

This shows that the second condition of Lemma 13.1.31 is met. Thus x 71 ^ 1 ) is in 7f SiT (x^) 
as needed. 

Now let x 7 be in 7f SiT (x A ). Then the conditions of Lemma 13.1.31 are satisfied. Thus 
[x 7 ]7fj(x' 3 ) = 1 for at least one (3 and Xi[ x/3 ]^t( xA ) — 2j[ x ^]^t( x *) = c as in Lemma 13.1.31 
For each j3 such that x' 3 is in 7f T (x A ) and [x 7 ]7fj(x /3 ) = 1 by the inductive hypothesis there 
are [x^]7f T (x A ) distinct LS-paths tt' e II r (A) such that 7r'(l) = /3. Thus we can write 
7 = /^(^(l) for one of these paths ir' and some positive integer t, where < t ^ [3i — j3,i + \ 
is determined by the action of 7fj on x' 3 . It remains to be shown that /„.(7r') := 7r is an 
LS-path beginning in the direction Sj7~(A). If this were not the case, then tt e II r (A) and 
maps uniquely to a path r\ as described above. This forces x 7 to not be in 7f SiT (x A ), which 
contradicts our first assumption. Thus 7 = 7r(l) for an LS-path in n SiT (A). □ 
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CHAPTER 4 

Permuted Basement Nonsymmetric Macdonald Polynomials 

In this chapter we show that the nonsymmetric functions obtained by permuting the 
basement in the combinatorial formula for nonsymmetric Macdonald polynomials |20| are 
eigenfunctions of a family of commuting operators. We begin in Section 14.11 by reviewing 
the necessary definitions of Hecke algebras. In Section 14.21 we review the combinatorial 
formula for nonsymmetric Macdonald polynomials given in [20j . In Section [4.31 we present 
Proposition 14.3.11 which is a relation between two combinatorial statistics given in the pre- 
vious section. Finally, in Section [4.41 we present Proposition 14.4.51 which is the main result 
of this chapter. 

All notations in this chapter conform to those found in |20j . For this chapter let 
N = {0,1,2,...} and let x := ( Xl , X2, ■ ■ ■ , x n ) be a finite set of indeterminates. 



4.1. Hecke Algebras 

Nonsymmetric Macdonald polynomials £L can be defined as eigenfunctions of certain 
commuting operators in the double affine Hecke algebra H n (q;t) of type A defined by 
Cherednik in |10| . This algebra can be defined as follows. 



Definition 4.1.1. The double affine Hecke algebra H n := H n (q;t) for n ^ 3 is the 
Q(q, t)-algebra with generators Tq,T\,T2, . . . , T n -i,ir and Xf l ,Xf l , . . . , X^ 1 and relations 

(Tj - t)(Ti + 1) = for sS i ^ n - 1 

TiTj = TjTi for i — j ^ +\mod(n) 

TiTjTi = TjT{Tj for i — j = +lmod(n) 

7rTj7r -1 = Ti + \ indices taken mod(n) 
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and 




for all i,j 



TiXj — XjTi 



for j ^= i, i + 1 mod(n) 



TiX{Ti — tXi + i 



for 1 ^ i < n 



irXiir 



i 



for 1 ^ i < n 



nqX n TT 



i 



ToqX n To = tX\ 



We will make repeated use of the relations in Definition 14. l.li We will also need Chered- 
nik's representation of H n on the vector space Q(q,t)[xf 1 , . . . , x* 1 ]. 

Definition 4.1.2. Let / e Q(g, t)[xf \ . . . , x± x ]. Then 

(1) X- acts by multiplication by xf 1 for 1 < i < n, 

(2) Ti/ = •/) + (*- 1) i^^t^t for < i < n, 

(3) T / = t(sj-/) + (t-l) (l^Jxi , where s -f(xi,. . .,x n )= f(qx n ,x 2 , ■ ■ . , x n -i, q -1 xt) , 

(4) tt/(xi, ...,!„) = /(x 2 , ...,^> 

Remark 4.1.3. We will make use of the fact that a function / e Q(q,t)[xf , . . . 
is symmetric in Xi,Xi + \ if and only if T/ = tf. 

Now define = t~ x T~\ ■ ■ • Tf 1 vrT n _i • • • Tj. These elements of fT,, satisfy = Y^ 
for all i and j, and Y^ acts on Q(g, i)[x] via Cherednik's representation. If we let 7 be a 
weak composition, define ji = q^" 1i t ki where 



We have the following Theorem from the literature, see [29] for example. We can take 
the follow theorem as our definition of nonsymmetric Macdonald polynomials. We note 
that Macdonald [39l defines these polynomials in terms of triangularity and orthogonality 
conditions. 

Theorem 4.1.4. The operators Yj admit a simultaneous eigenbasis E~(x\, . . . ,x n ;q,t), 
called nonsymmetric Macdonald polynomials, with eigenvalue 7$. That is 



ki = \{j = 1, • • • ,i ~ 1 I lj > 7i}| - Ki = i + 1) • • • > n I lj > 7i}l- 



YiE 7 (x;q,t) = q-in ki E^(x;q,t). 
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4.2. Combinatorial Definitions 

Now we will present the definitions necessary to state the combinatorial formula for 
nonsymmetric Macdonald polynomials given in [20j . 

Let 7 = (71, . . . , 7 n ) be a weak composition with n parts. We will visualize 7 as a skyline 
diagram or column diagram, which is the set 

dg(7) = {(*,i) 6 N x N [ 1 < i < n, 1 < j < 7i} 

where i indexes the columns and j indexes the rows. Thus, the diagram's coordinates are 
in Cartesian coordinates. 

The augmented diagram of 7, denote dg(7), will be the diagram obtained by adjoining 
n extra boxes in row 0, thus adding a box at the bottom of every column of dg(7). 



Definition 4.2.1. Given 7 a weak composition with n parts and a box u = e 
dg(7), define 

(1) leg(u) = {(*,/) edg( 7 ) I f>j} 

(2) arm lcft (u) = {(»', j) e dg( 7 ) \ i> < i, A*/ < A,} 

(3) arm ri g ht (u) = {(»', j - 1) e d£( 7 ) | i' > i, ^ < AJ 

(4) arm(ti) = arm left («) u arm nght (u) 

(5) = |leg(n)| = 7i - j 

(6) a(ii) = I arm(«)| 



Example 4.2.2. If 7 = (3,1,2,4,3,0,4,2,3) and u = (5,2) then the cells belong- 
ing to leg(u), arm left (u), and arm right (it) are marked by x, y, z in the following figure: 





















X 










y 




y 




u 




















z 























giving l{u) = 1, a(u) = 3. 
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A filling of 7 is an assignment of positive integers to the boxes of dg(7). We will denote 
fillings by the associated map a: dg(7) — * [re]. Let r e S n , then the associated augmented 
filling with basement r is the map a T : dg(7) —* [re] such that a T agrees with a on dg(7), 
and row has a T ((j, 0)) = r(j), for 1 < j < n. That is, row has the permutation r 
written in one-line notation. It is at this point that we depart slightly from the definitions 
where the authors only consider the identity permutation r = e in row 0. Instead, 



m 

we present their definitions for arbitrary r. 

Two cells in dg(7) are said to be attacking if either 

(1) they are in the same row, or 

(2) they are in consecutive rows, and the cell in the higher row is strictly to the left 
of the cell in the lower row. 

A filling <7 r is called non-attacking if & T {u) & T (v) for all pairs of attacking boxes u, v e 
dg(7)- 



Example 4.2.3. Below is a non-attacking filling a T of shape 7 = (2,1,3,0,0,2) with 
basement entries given by r = S2S1S3. 



dg(7) 



2 5 



Let d(u) = (i,j — 1) be the box directly below u = For any 7, a descent in a 

filling <7 r of 7 is a box u e dg(j) such that d(u) e dg(7) and a T (u) > d T {d(u)). We define 



(4.1) 

and 

(4.2) 



Des((7 T ) = { descents of a 7 "}, 



maj(a T )= £ (*(«) + 1) 

«eDes(<7 r ) 
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The reading order of a diagram dg(7) is the total order of the boxes of dg(7) obtained 
by reading the cells row by row from left to right, starting in the top row and working 
downward. An inversion is a pair of boxes u, v e dg(7) such that 

(1) u and v are attacking, 

(2) u < v in reading order, and 

(3) a T (u) > d T (v). 

Notice that the inversions with both u and v in row are exactly the inversion of the 
permutation t . Define 



(4.3) Inv(a T ) = { inversions of <7 T }, 

(4.4) inv(a r ) = | Inv(a r )| - \{i < j | 7i ^ 7i }| - £ a(u), 

ueDes((T T ) 

and 

(4.5) coinv(? T ) = ^ a(u) J - iiw(a T ). 

\MGdg(7) J 

The statistics inv(a T ) and coinv(<7 T ) will henceforth be called the inversion and coin- 
version statistics, respectively, to differentiate them from the following notions of inversion 
and coinversion triples. 

A triple is three boxes (u,v,w) £ dg( 7 ) such that w = d(u) and v e arm(u). That is, 
the boxes have one of the orientations 

Type I Type II 

u 
w 

The total number of triples in a T is equal to Xi ne d g ( 7 ) o(it). 

Informally, we say that a triple (u, v, w) in a T is a coinversion triple if its entries increase 
clockwise in Type I or counterclockwise in Type II. If two entries in the triple are equal, 
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we say the entry read first in reading order is smaller. We say a triple (u, v, w) in a T is an 
inversion triple if it is not a coinversion triple. 

Inversion triples can be defined formally as follows. Given a filling a T and boxes x, y e 
dg(7) with x < y in reading order, define 



Let (u, v, w) be a triple. Then we see 

• Xuv(& T ) = 1 if and only if (u, v) e Inv(<r T ), 

• Xvw(& T ) = 1 if and only if (v,w) e Inv(<7 r ), and 

• Xuw{v T ) = 1 if and only if u e Des(<7 T ). 

From this it follows that Xuv(& T ) + Xvw(& T ) — Xuw(S' T ) e {0, 1}. Whenever Xuv(& T ) + 
Xvw(& T ) — Xuw(& T ) = 1 we call the triple (u, v, w) an inversion triple. Similarly, if Xuv{& T ) + 
Xvw(& T ) — Xuw{& T ) = the triple (u,v,w) is a coinversion triple. Let Invtrip(<7 r ) and 
Coinvtrip(cr r ) be the number of inversion and coinversion triples, respectively, in a T . 



Before stating the combinatorial formula for £L, we show how the coinversion statistic 
relates to the number of coinversion triples. 
For integers a and b, define 



The authors in |20j show that coinv(a e ) = Coinvtrip(5 : ' E ). Recall that a pair is an 

inversion of r if and only if i < j and r(i) > r(j). If (i,j) is an inversion of r, then in a 



(4.6) 




4.3. Determining the Coinversion Statistic 



(4.7) 




filling <7 r of dg(7) we see that ji and 7,- are the heights of the columns above the basement 
entries r(i) and r(j), respectively. In this section we prove the following. 



Proposition 4.3.1. With the notation above 







is an 
inversion of r 
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Before we prove this proposition we need the following lemma from |20] which is readily 
checked. 



Lemma 4.3.2. Every pair of attacking boxes in dg(7) occurs as either {u,v} or {v,w} 
is a unique triple (u,v,w), except that an attacking pair {(i,0), (j, 0)} in row 0, with i < j 
and 7j ^ jj, is not in any triple. 



Proof of Proposition I4.3.1L The sum over all triples, 
(4.9) J] {Xuv{d T ) + Xv W {o T ) -XuU^l) 

(u,v,w) 

is equal to the number of inversion triples, Invtrip(<7 T ). We claim that 

2 (Xuv{o T ) +Xvw{v T )) = |Inv(5 T )| - \{i <j | 7i «S + ^ xili^lj)- 

(u,v,w) is an 

a triple inversion of r 

To see this, note that J]( u v w ){Xuv{o T ) + Xvw{o T )) counts all the inversions in d T except 
those of the form {(i,0), (j, 0)}, with r(i) < r(j) and 7 j «S jj. Consider an inversion of 
r and assume 7 { > jj. Then the boxes in the basement containing r(i) and t(J) are not an 
inversion of a T because r(i) > r(j). When 7 j > jj then the pair of attacking boxes t = (i, 0) 
and s = (j, 0) is in a unique triple (r,s,t) by Lemma 14.3.21 where r is the box (i, 1). Since 
(s,t) is not an inversion of a T , then (r,s) e Inv(<7 T ) if and only if Xrs(& T ) + Xst(& T ) = L 
The inversion of r is not counted in x(7i ^ 7j')- 

If 7i *S 7j, then the boxes (£, 0) and (j, 0) are still not an inversion and they do not 
appear in any triple. The term \{i < j ' \ ji < counts all pairs of boxes (x,y) in row 
with the corresponding column heights weakly increasing as inversions. But clearly this 
term over-counts because each inversion of r that satisfies 7 j < jj, which is counted 
in \{i < j | 7j < 7j}|, is not an inversion of a T . Thus we have 

2 (Xuv{Z SlT ) + Xvw{o SlT )) = | Inv(£ T )l - |{« < 3 I 7i < 7j}| + 2 X ^ 7i ** 

(u,t),tu) (ij) is an 

a triple inversion of r 
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Finally, we see that ^( uvw ) Xuw{o~ T ) is equal to ^jneDesfcr 7 ") Thus we have 



Invtrip(cT) = | lnv(a T )\ - \{i < j \ j { «c ^}\ + ^ x(7i < 7j) - X! a ( n ) 

usDes(<T T ) 



(ij) is an 
inversion of - 



mv 



(£ T ) + £ X(7i < lv 



is an 
inversion of r 



It follows that 



nv(tT r ) = ^ a(it) 
iuedg(7) 



2 a ( n ) 

«Gdg(7) 



inv(<7 r ) 

/ \ 

Invtrip(<7 r ) - ^ X(7» < 7? 



V 



is an 
inversion of r 



/ 



Coinvtrip(5 :r ) + x(li < 7j)- 



(ij) is an 
inversion of r 



□ 



4.4. Permuted Basement Nonsymmetric Macdonald Polynomials 

In this section we first state the combinatorial formula for nonsymmetric Macdonald 
polynomials given in |20j. Then we will use the relation in Proposition 14.3. H to state 
how the nonsymmetric Macdonald polynomials transform under the action of the generator 
Tj e H n ; this result was first communicated in [18) . We then use this result to show that 
the nonsymmetric polynomials obtained by permuting the basement in the combinatorial 
formula for E~ are eigenfunctions of a family of commuting operators. 

In [20] the authors prove the following. 

Theorem 4.4.1. ( [20| ) The nonsymmetric Macdonald polynomials Ey(x\, . . . , x n ; q, t) 

are given by 

l-t 



(4.10) E 7 (x;q,t)= £ ^maK^coinv^) 

cr: 7— >[n] uedg(7) 
non-attacking a e (u)^a' s (d(u)) 



where e is the identity permutation and x a = riuedg(7) x o-(u) ^ s the weight of the filling a. 
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Note that in Theorem 14.4.11 the statistic coinv((7 e ) can be replaced by Coinvtrip(<j e ), 
and in fact this is what the authors in [20] use to prove Theorem 14.4.11 

The definitions needed to describe the combinatorial formula above (non-attacking fill- 
ings, maj, coinv, and so on) are still valid when working with an arbitrary basement r. 
Thus we define permuted basement nonsymmetric polynomials as follows. 

Definition 4.4.2. Let r e S n . The permuted basement nonsymmetric polynomials 

E ljT (xi,x 2 , ... ,x n ;q,t) are given by 

(4.11) E 7 , T (X;^)= 2 ^K^Coinvtrip^) • 

a: 7— >[n] uedg(-/) 
non-attacking o T (u)^a T (d(u)) 

We note that -E 7]T is defined using the number of coinversion triples Coinvtrip instead 
of the coinversion statistic coinv. This is so that the study of permuted basement nonsym- 
metric polynomials in this dissertation conform to [18] and a forthcoming paper |23j. 

We wish to establish two results in the remainder of this chapter. The first is to record 
the relationship between E~ T and E~ u for 7 > uj in weak Bruhat order. This was first 
done in |18j . The second is to show the functions E~ T are eigenfunctions for a family of 
commuting operators in H n . One lemma needed to establish the first result is the following. 

Lemma 4.4.3. For < i < n and any F,G e Q(q, t)[xi, . . . , x n ] the following are 
equivalent. 

(1) TiF = G, 

(2) F + G and tXi + \F + xiG are both symmetric in Xi,Xi + \. 

Proof. From the defining quadratic relation (Tj — t)(Ti + 1) = in H n we see T? = 
(t — l)Tj + t. We will also make use of the defining relation TjYjTj = tXi + \ and Remark 

Assume T{F = G. Then we compute 

Ti{F + G) = T t {F + TiF) = T,(l + TJF 
= t(l + Ti)F = t(F + G). 



Thus F + G is symmetric in Xi, Xj+i. 
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We also see 

Ti{tx i+1 F + Xi G) = Ti{tx i+1 F + Xi {TiF)) = T { (tx i+1 F + (T t + 1 - t)(x i+1 F)) 

= Ti(t + Ti + 1- t)x i+1 F = t(Ti + l)x i+1 F = t{T iXi+l F + x i+1 F) 
= t ( Xi T t F + (t- l)x i+1 F + Xi+iF) = t(tx i+1 F + Xi G). 

For the converse, assume F + G and tXi + \F + XiG are both symmetric in Xj, Xj+i. Thus 
we have 

F + G = { Si F) + ( Si G) and 
tx i+ iF + XiG = tXi(siF) + x i+ i{siG). 

So we can compute 

T,F = t{ Si F) + (t- l)xi+i 1 
= t{ Si F) 
= t( Sl F) 
= t{ Si F) 



tXj+iF - tXj+iSjF _ x i+1 F - x i+1 SjF 

tXjSjF + Xj+iSjG - XjG - tXj+iSjF x i+ iSjF - x i+ iF 

(Xi — Xi+i)ts{F Xi+\SiG — XiG Xi+\SiF — xi+\F 



x i+1 SjG - XjG + x i+ iSjF - Xj+iF 

Xi+l X{ 

x i+1 (sjG + 3jF) - XjG - x i+1 F 

Xi+i Xi 

G. 



□ 

Lemma 14.4.31 can be used to prove the following proposition, which was first commu- 
nicated to this author in |18j . Recall, the polynomials i? 7jT are defined using Coinvtrip 
instead of coinv. 

PROPOSITION 4.4.4. lJT8\) Let r e S n and i be such that < i < n and £(s;t) > £(t). 
In the augmented filling with basement given by r, let a be the height of the column above 
the entry i in row and let b be the height of the column above the entry i + 1 in row 0. 
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Then 

(4.12) TiE y>T = tX^Ew 

Remark 4.4.5. Let r e S n be reduced. Using Proposition 14.4.41 inductively we see 

(4.13) T r £ 7i£ = t c E liT 

where c is the constant c = Ylxili ^ 7j)j where the sum is over all inversions of r. 

The remainder of this chapter will be used to show the operators , whose definition 
follows, are the family of commuting operators in the double affine Hecke algebra for which 
E^ )T are eigenfunctions. 

Definition 4.4.6. Let Y[ = t^T-tx ■ ■ ■ T^irT^ 1 ■■■T e ^ with e s e {-1, 1} and ej = 
|{i|l ^ j ^ n — 1 such that Ej = — 1}|. Define Ej via: 

(1) For indices j with i ^ j < n: Ej = —1 if + 1) form an inversion in r, and 
Ej = 1 else. 

(2) For indices j with 1 ^ j < v. Ej = 1 if (j, i) form an inversion in r, and £j = — 1 
else. 

The following lemma gives the relation between the DAHA generator Yi and the operator 
Y[ in H n (q,t). 

Lemma 4.4.7. For all 1 ^ i ^ n and r reduced we have 

(4.14) if = T T Y T -, {i) T-\ 

Proof. We induct on the length of r. If r = e is the identity then T T = 1 and then 
(|4.14p is Yf = Yi. If r = Sj has length one, then we will prove Y^ j = TjY s .^T^ 1 in the 
following four cases. 
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Assume j < i — 1. Then 

T^T- 1 = TjYiTj 







i T 


-} 1 ---T{ 1 KT n - 1 ---T i )Tr 1 




= & 




-i 
-i ■ 




ray 1 


= & 




-i 
-i ■ 


rri — 1 m — It 1 T — 1 ^rri 

" 1 3+^ 1 3 7Tl n-l 


■■■T(T- 


= f~ 




-i 
-i ■ 


■ ■ T{ l Tj + iitT n -i ■ ■ ■ TiTj 1 




= & 


%- 


-i 
-i ■ 


■■T^ 1 nT J T n _ 1 ---T l Tr 1 




= f- 


■% 


-i 
-i ■ 


■ ■ T-f 1 vrT n _i • • • Ti 




= y; 











1 



Similarly, if j > i then 

= Tj (t*" 1 ^ • • • T^nTn-t ■■■T i ) Tr 1 
= f- 1 ^ • • • T^TjirTn^i ■ ■ ■ X{Tj x 
= ?- l Tr_\ ■ ■ ■ TfVT^T^! • • • T.Tr 1 
= f^T'-i . . . Tf \T n _ x ■ ■ ■ T, 1)1) | • • • 
= f- 1 ^ . . . T^TiT n ^ ■ ■ ■ TjTj^iTj ■ ■ ■ TiTT 1 
= y" Sj 

i ' 

If j = i then 

= T t {t l Tr l . . . Tf VT n _! • • • T i+l ) Tr 1 
= ?T-\ ■ ■ ■ T^nTn-t ■ ■ ■ T^Tr 1 
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Similarly, if j = i — 1 then 



T 3 Y sj{i) T i 1 = T i-l Y i-l T i-l 



Ti-i {f- 2 Tr_\ . . . Tf 1 ^-! • • • 2^1 



j.2 — 2r7-i rj-i — 1 rri — 1 ^rri rr\ 

t ij_iij_ 2 • • • l x ir± n -\---±i 



Y~ s i— 1 _ y*j 



Now assume Yj T = T T Y T -xu\T T 1 for all r of length at most L. Assume that £{sjr) 
L + 1. Using the inductive hypothesis we see = T T Y T -i^ s .^T^ 1 , and so 

T 3 Y J j (i) T j~ = T i T rY T -i( Sj(i ) ) T7 1 rr 1 = T Sj . r Y r -i Sj . (i) :r~ r . 

Again we proceed by cases. 
Assume j < i — 1. Then 

Ws^Tf 1 = T 3 (^Ttl 1 • • • IfvrT^ 1 • - - 7f ) ly 1 

= i^I^i 1 • • • T J T ! :\ T J ■ ■ ■ T^ttT^Ti • • • Tf'Tf 1 . 

Since + 1) is not an inversion in r and j < i — 1, we see that TjTj^Tj-' is equal to 



. TjTr^TT 1 ^ T = r(l) ■■■]■■■;, ■ 1 r(n), or 

• r i T i+i T j rl ^ T = T ( 1 ) • • • J j + 1 • • • r(n), or 

• T i T i+i T i o T = r ( 1 ) ■ J • • -J + 1 ■ ■ ■ T ( n )- 



In each case we can apply a braid relation yielding T- 3 _^T- j Tj + i. In the first and third 
cases e'j +1 = £j+\ and e'j = £j. In the second case e^ +1 = —Sj+i and = — £j. Since the 
total number of indices k for which = — 1 is unchanged, we have e[ = e s i jT . In all cases, 
after the braid relation, we have 

^M 7 ! 1 = flT i-i • • • ?f T^ttT^ 1 • • • T^T- 1 
= fil*^ 1 ■ ■ ■ T^ttTjT^Ti ■ ■ ■ TpTT x 
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Next, assume j > i. Then similarly 

TjK^T- 1 = Tj {f*T^ ■ ■ ■ T^ttT^ ■ ■ ■ If) Tf 1 

J.eJrpEi — 1 rpEl rpSn-1 rp rp£jrp£j — l rpEirp—1 

Since + 1) is not an inversion in r and j > i, we see that Tj—iT^T^^] 1 is equal to 

• T^{T- x T-\ <*> r = r(l) •••./•••./ • 1 •••/••• r(n), or 

• 1) 1)1) \ o t = r(l) •••./•••/•••.; • 1 ••• r(n), or 

• Tj-xTjTj-i o t = t(1) ...{■■■ + !■■■ T (n). 

Just as before, we can apply a braid relation yielding T- 3 T-^Tj. In the first and third 
cases e'j_ 1 = £j-\ and e'- = ej. In the second case = ~ £ j-i an d £j = —£j- Again, the 
total number of indices k for which = —1 is unchanged, so e\ = £^ T ■ In all cases, after 
the braid relation, we have 



T \rr rp- 



,flT^---T^T j T^...T^ 



= V- 

i 

Now assume j = i. Because (i, % + 1) is not an inversion in r, we may write 
T t Y[ +l T^ = Tl (t^Tf 1 ■ ■ ■ T^nT^ 1 ■ ■ ■ T^) Tf 1 

= Y SiT 

i 

because e[ +1 = e\ iT . 

Similarly, assume j = i — 1. Because j = i — 1 and i are not an inversion in r we may 
write 

T^YUTiX = (f-^ ■ ■ ■ T^nT^ 1 ■ ■ • TVi) Tr\ 
= tf-iTi-tTf^ 2 ■ ■ ■ T^Tn-'i ■■■ T i i 
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because e[_ x = e^ 7 . 

Thus we have shown = T T Y T -iu\T~ for r e S n . 

□ 

Using Proposition 14.4.41 Remark 14.4.51 an d Lemma [4.4.71 we can give the main result of 
this chapter. 

Proposition 4.4.8. The functions E~ jT are simultaneous eigenf unctions of the operators 
PROOF. We compute 

YTE^ T = Yf(t- C T T E^) 

= t~ c T T Y T -i^T~ (T T E lte ) 

= 7r- 1 (i) £; ^ T 

where is the eigenvalue of Y T -iu\ acting on the nonsymmetric Macdonald polynomial 

Ej, and c is the constant c = ^x(n where the sum is over all inversions of r. 

□ 
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